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Preface 

The work reported here started in 1977 with a general as- 
sessment of the state-of-the-art in modeling human behavior 
in complex man-machine systems. It had been found that plan- 
ning is an increasingly important task the nature of which, 
however, has not been well understood [Johannsen, Rouse, 1979]. 

Two subsequent experiments were accomplished in 1979-1981 in 
order to investigate the planning process of humans in a real- 
istically simulated work environment. The experiments were 
run in ?n aircraft simulator at the PAT in P.R. Germany 
(Johannsen, Hillmann) whereas the data analyses were calcu- 
lated in the United States (Rouse) . Rouse started this work 
at the University of Illinois at Urbana-Champaign and continued 
it at his present affiliation, Georgia Institute of Technology, 
Atlanta. 

This research was partially supported by the National Aero- 
nautics and Space Administration under Ames Grants NSG-2119 
and NAG 2-123. Early discussions about the methodology with 
■people from NASA and Lufthansa were very helpful and have 
been greatly appreciated. 

The authors gratefully acknowledge the assistance of W.-D. Huland 
and W. Krliger in this work as well as the very open-minded and 
pleasant cooperation with the participating pilots of the Flug- 
bereitschaft from Kdln/Bonn airport. Finally, we thank S. Degen 
for typing the manuscript and D, Schmitt for drawing the fig- 


ures . 
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Abstract 

Planning will become an increasingly central function for 
the human operator as automation takes over more and more 
of the manual tasks associated with man-machine systems. 

In order to understand and aid the human in this role, an 
experimental methodology for the study of human planning 
behavior i.s needed. Further, a model of the process by which 
the human plans is desirable. 0?his report presents a method- 
ology for studying planning and discusses the results of 
applying the methodology within two experimental investiga- 
tions of planning behavior of aircraft pilots in normal, 
abnormal, and emergency situations. Beyond showing that the 
methodology yields consistent results, these experiments also 
produced new concepts in terms of a dichotomy betv’een event- 
driven and time-driven planning, subtle effects of automation 
on planning, and the relationship of planning to workload 
and flight performance. 

Kurz fas sung 

Planung wird eine zunehmend zentrale Funktion fUr den Menschen 
als Operateur werden, da die Automation mehr und mehr manuelle 
Aufgaben in Mensch-Maschine-Systemen iibernimmt. Urn den Menschen 
in dieser Rolle zu verstehen und zu unterstiitzen, wird eine 
experimentelle methodische Vorgehensweise fiir die Untersuchung 
des menschlichen Planungsverhaltens benotigt. Weiterhin ist 
ein Modell des Prozesses des menschlichen Planens wiinschens- 
wert. Dieser Bericht beschreibt eine methodische Vorgehensweise 
fiir die Erforschung der Planung und diskutiert die Ergebnisse, 
die bei der Anwendung der Methods gewonnen wurden, und zwar 
in zwei experimentellen Untersuchungen des Planungsverhaltens 
von Flugzeugpiloten in normalen, auBergewohnlichen und Notfall- 
situationen. Es wird gezeigt, daB die methodische Vorgehens- 
weise folgerichtige Ergebnisse liefert. AuBerdem ergaben die 
Experiments neue Konzepte beziiglich einer Zweiteilung zwischen 
ereignis- und zeitbedingter Planung, beziiglich sinnreicher Aus- 
wirkungen der Automation auf die Planung sowie fiir die Be- 
ziehung der Planung zur Beanspruchung und Flugleistung. 
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In a recent paper [Johannsen and Rouse, 1979], the authors 
reviewed the problem of modeling human behavior in complex 
man-machine systems. One particularly important conclusion 
of this review was that planning will become an increasingly 
central function of the human as automation takes over more 
and more of the manual tasks. It was also concluded that the 
human's planning process is not very well understood. The 
purpose of the research summarized in this report has been 
to increase understanding in this area. 

Previous researchers have certainly recognized the human's 
role as a planner in man-machine systems [Sheridan, 1976] . 
However, there appear to have been very few attempts to 
measure and model the human's planning process. Notable 
exceptions to this conclusion include several efforts in the 
field of artificial intelligence and cognitive science. 

Three especially important concepts have emerged. The first 
is that planning can be avoided if one employs a standard 
"script" [Schank and Abelson, 1977] or "frame" [Minsky, 1975] 
that specifies the likely sequence of events and appropriate 
actions within a particular domain. For example, one has a 
"driving to work" script that allows one to accomplish this 
task with a relatively low investment of effort. 

Another important concept that has emerged is that of hier- 
archical planning [Sacerdoti, 1975; Weissman, 1976]. In a 
planning hierarchy, the depth of planning can range from 
broad and sketchy to narrow and concise. In this way, one 
can avoid investing effort in detailed planning until it is 
necessary. Once ’ ae accepts the idea of hierarchical planning, 
it is reasonably natural to become interested in the deter- 
minants of the level of the hierarchy in which a planner 
chooses to operate. This report addresses this issue. 
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The combination of scripts, frames, and hierarchical planning 
emphasizes a rather top-down view of planning where goals 
lead to subgoals, plans lead to subplans, and the process 
smoothly progresses* An alternative view is the "opportu- 
nistic" model of Hayes-Roth and Hayes-Roth [1979], In this 
model, high-level and low-level aspects of planning compete 
for attention in a somewhat interrupt-driven manner. While 
one can view these interrupts as occurring randomly, the 
resulting perspective is of a rather disorderly process. A 
more palatable view is that "events" cause interrupts. The 
nature of these events is explored in this report. 

The overall goal of the research discussed in this report 
has been to develop a methodology suitable for measuring 
planning activity and modeling the planning process of human 
operators in complex dynamic systems, in this case aircraft. 
This VfOrk has benefitted greatly from the concepts summarized 
in the above paragraphs. The main contribution of this work 
has been the development of a rigorous experimental method- 
ology, its application to two experimental studies within a 
realistically complex man-machine system [Johannsen and Rouse, 
1980, 1981 ], and the interpretation of experimental results 
in terms of concepts for modeling the process of planning. 

2. Method 

2 . 1 Subject Population 

In the experiments, the planning process of aircraft pilots 
has been investigated. An HPB-320 Hansa Jet simulator at 
the Forschungsinstitut fiir Anthropotechnik (PAT) was employed 
[Holzhausen and KUhne, 1974]. 

Using this simulator, nine professional HPB-320 pilots flew 
several missions from cruise to touch down. Three pilots 
participated in a pilot study, another three pilots in 
Experiment I, and the last three pilots in Experiment II. 


The subject population of Experiments I and II was highly 
homogenous, averaging just under 5000 flight hours each of 
which approximately one-third wore in the HFB-320. The pilots 
had almost no or only little experience with flight simu- 
lators. The average age of the group was 39. 

2.2 Flight Simulator 

The HPB-320 Hansa Jet is a 5 - 12 passenger, twin engine jet 
used for both military and commercial purposes. It normally 
has a two-man crew. 

The HPB-320 flight simulator at the FAT allows full maneuver- 
ability, is fixed base, and has no visual simulation of the 
outside view. The cockpit is an original mockup from the air- 
craft manufacturer. It is instrumented with conventional dis- 
plays for flight, engines, and navigation as well as controls 
that include steering force simulation. Also, a fairly sophis 
ticated autopilot as well as a flight director with V-bar 
indicators in the artificial horizon are available. However, 
some limitations are present as the flight instruments for 
the copilot, the controls in the overhead panel, and a simu- 
lation of waypoints for navigation are missing. These limi- 
tations restrict the possibilities for simulating emergency 
situations. Further, it was necessary to run the experiments 
with a second experimenter playing the combined role of the 
copilot and the air traffic controller. 

A more detailed description of the HFB-320 simulator is given 
in Appendix A. 

2.3 Flight Scenarios in General 
2.3.1 Normal Scenario 

Three flight situations were studied: 1) normal, 2) abnormal, 
and 3) emergency. The "normal" flight scenario N which was 
the basic one in these experiments is illustrated in Figure 1 
with a plan view and a side view. There, eight flight phases 
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are shown, namoly: 1) Cruise, 2) Doscont, 3) Holding, 

4) Initial Approach, 5) Pinal Approach, 6) Landing, 7) Ground 
Roll, and 8) Cruise to Alternate. The overall mission of the 
N scenario lasted approximately 20 minutes when no cycles 
of the holding pattern or cruise to alternate were to be 
flown. No unusual events occurred. In Experiment I, the 
N scenario was flown with three cycles of the holding pattern 
and lasted approximately 32 minutes, whereas no holdings were 
flown in Experiment II. For more details, see Appendices B.1,1 
and B. 2 . 1 . 



Figure 1 ; Course and flight phases of basic flight scenario 
(plan and side view) 

The pilots were asked to use the flight director and the 
automatic throttle system in order to obtain more steady flight 
conditions. This request remained unchanged throughout all 
flight scenarios. 


2.3.2 Abnormal Scenarios 


'The abnormal flight scenarios (denoted by and A 2 ) v;ore 
characterized by procedural changes. In Exj.*;friment I, the 
pilots received information that the runway had boon closed 
temporarily/ snow removal was in progress, and that they 
were requested to enter a holding pattern. The information 
was given at two time instances, at 4.75 min after starting 
the experimental run, i.e., during Cruise, in scenario A^ , 
and at 13,75 min with a warning at 8.25 min (’’snowfall ex- 
pected") in A 2 . This resulted in a holding pattern before 
the descent in scenario A^ whereas the sequence of the flight 
phases in Ag was the same as in the basic scenario N. During 
the holding patterns in A^ and the additional flight 
phase (8) emerged as a possibility for the pilots, i.e., 

’’Cruise to Alternate", Before completing the third cycle of 
the holding pattern, the pilots received information that 
the runway was "clear and wet" and that they could continue 
their approach. Due to the three cycles of the holding pattern, 
these abnormal flights lasted approximately 32 minutes. 

In Experiment XI, abnormality A^ involved a temporary runway 
closure due to snow removal, which was announced 4.2 minutes 
into the flight and presented the possibilities of requiring 
the pilot to enter the holding pattern or to cruise to the 
alternate airport. Abnormality involved temporary CAT-III 
conditions due to a dense fog, which was announced 7.5 minutes 
into the flight and presented the same possibilities as ab- 
normal situation A^ . while the possibilities of holding or 
cruising to an alternate were clearly shown on the map fur- 
nished to the pilot (and available in the cockpit) , the ab- 
normal situations were always resolved at the last minute 
and holding and cruising to an alternative always avoided. 

In this way, all flights were limited to 20 minutes. 


For more details, see Appendices B.1.2 and B.2.2. 


2,3,3 Emorgency Sconarioa 


In Exporimont I, the emergency flight scenarios (denoted 
by E^ and E 2 ) wore characterized by a failure of the right 
engine, namely, a shut-down. In case E^ , the failure occurred 
a short time before the pilot would have boon roguostod to 
enter the holding pattern in the basic scenario. Of course, 
the holdings had to bo omitted with a single engine failure, 
which resulted in a time duration of the whole mission of 
approximately 20 minutes. The other scenario E 2 included the 
same seguence of flight phases as the basic one (i.e,, N) 
with the single engine failure occurring shortly after the 
aircraft was expected to pass the outer marker (see OM in 
Figure 1). In both cases, flight control was accomplished 
manually. Otherwise, the autopilot would have compensated for 
the engine failure, and the pilots would have been unable to 
detect it. 

In Experiment II, emergency involved the failure of the 
right engine at 4.2 minutes into the flight. The failure was 
announced by an alarm in the cockpit similar to that in real 
HFBs. In this way, thw t* V'as no problem with the pilot miss- 
ing the failure, even iiights with autopilot. Emergency E 2 
involved a severe loss of hydraulic pressure due to a total 
loss of hydraulic fluid, i.e., oven the hand pump for the 
gear was inoperative and an emergency landing was reguested. 
This failure was announced at 7.5 minutes into the flight by 
the alarm in the cockpit. 

For more details, see Appendices B.1.3 and B.2.3. 

2 . 4 Measures 

2.4.1 Depth of Planning and Timeline 

The objective of this study was to measure the planning pro- 
cess of pilots during the different flight situations just 
described. The notion of depth of planning has been intro- 
duced as the basic concept for this purpose. Depth denotes 


lev«ax of detail which can range from broad and sketchy to 
specific and concrete. The hypothesis was that planning 
with respect to a particular task need not be very deep if; 

1 ) The amount of time until the task must be performed 
io large. 

2) The task is not critical to mission success, 

3) It appears that the environment will be "hospitable" 
to successfully completing the task (i.e., the proba- 
bility of increased difficulty will be low) . 

However, if one or more of these conditions ceases to hold, 
then depth of planning will increase to the extent that the 
conditions are not satisfied. In other words ^ the depth of 
planning associated with a particular task will be very great 
if the task must be performed immediately, is critical to 
mission success, and may be more difficult than usual to 
accomplish. 

Thus, the hypothesis is that depth of planning is affected 
by the three independent variables: time, criticality, and 
probability of increased difficulty. To evaluate this hypoth- 
esis, it was necessary to measure depth of planning as well 
as its three independent variables. The measures for diffi- 
culty and criticality will be described in Section 2.4.2. 

For the first variable (i.e., time), a timeline indicating 
when things are supposed to happen was constructed for all 
flight scenarios. This was not only done for the beginning 
of the 8 flight phases but also for the beginning of three 
selected subtasks for each flight phase (see Table 1). The 
subtasks were chosen after discussions with aeronautical 
engineers and pilots in order to characterize a second more 
detailed level of each flight phase by means of typical 
examples (e.g., altimeter, localizer intercept, gear, cross- 
wind) . 
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Table 1 : Timeline - Beginning of flight phases and 
subtasks for Experiment I 


1 . Cruise 

1 . 1 Approach procedure 

1.2 Request to leave flight level 

1.3 Fuel control (+ Power setting) 

2. Descent 

2.1 Obstacle clearance 

2.2 Flight instruments 

2.3 Altimeter 

3. Holding 

3.1 Track intercept 

3.2 Traffic orders (+ information) 

3.3 aTIS (e.g,, runway condition, 

weather, QNH) 

4. Initial Approach 

4. 1 Flaps 

4.2 Localizer intercept 

4.3 Glides lope intercept 

5. Final -Approach (OM inbound) 

5 . 1 Gear 

5.2 Weather minima 

5.3 Flare 

6. Landing (Flare + Touch down) 

6.1 Crosswind 

6.2 Runway condition 

6.3 Passenger comfort 


N, 


E 





^2 

0 : 00 

0 

» 

00 

0 : 

00 

0 

o 

o 

6 : 15 

6 


15 

6 ; 

15 

6 

; 15 

-2 ; 00 

-2 

• 

00 

-2 ; 

00 

-2 

: 00 

0 ; 00 

0 


00 

0 : 

00 

0 

: 00 


7 ; 

15 

7 ; 

15 

19 

; 15 

7 : 15 

7 : 

15 

7 : 

15 

19 

: 15 

7 ; 15 

7 : 

15 

7 ; 

15 

19 

: 15 

7 •. 15 

7 : 

15 

7 : 

15 

19 

; 15 

7 ; 15 


15 : 

15 

= 

6 : 

15 

15 : 

15 

15 ; 

15 

- 

6 : 

15 

15 ; 

15 

15 ; 

15 

- 

6 ; 

15 

15 ; 

15 

8 j 

15 

8 ; 15 

19 

20 

25 : 

20 


26 J 45 

15 : 15 

26 

: 45 

26 

; 45 

28 ; 00 

~16 : 30 

~28 

: 00 

-28 

; 00 

28 : 30 

~17 : 00 

~28 

; 30 

~28 

: 30 

29 ; 30 

-“18; 15 

-29 

: 30 

-29 

: 30 


■29 

: 45 

-18 

: 30 

-29 

: 45 

-29 

: 45 

■29 

; 30 

-18 

; 15 

-29 

; 30 

-29 

; 30 

■31 

: 15 

0 

CM 

1 

: 15 

-31 

: 15 

-31 

: 15 

■31 

: 20 

-20 

: 20 

-31 

; 20 

-31 

: 20 


-31 

: 15 

0 

CM 

1 

15 

-31 : 

15 

-31 

; 15 

-31 

: 15 

-20 : 

15 

-31' : 

15 

-31 

: 15 

-31 

; 15 

-20 j 

15 

-31 : 

15 

-31 

: 15 

-31 

; 15 

-20 : 

15 

-31 : 

15 

r3i 

: 15 


Table 1 (Continued) : 




N, 

^2 


^1 



^2 

7. 

Ground Roll (after Landing) 

-31 

: 30 

-20 

; 30 

-31 

: 30 

-31 : 30 


7.1 On centerline 

-31 

; 30 

-20 

; 30 

-31 

: 30 

-31 : 30 


7.2 Speed brakes 

-31 

; 30 

-20 

: 30 

-31 

! 30 

-31 5 30 


7,3 Flaps 

-31 

! 30 

-20 

; 30 

-31 

; 30 

-3f : 30 

8. 

Cruise to Alternate 


- 


- 

not 

occurring 

not 

occurring 


8.1 Approach procedure 


- 


- 

4 

; 45 

13 ; 45 


8.2 Request to leave flight level 


- 


- 

4 

; 45 

13 : 45 


8.3 Fuel control (+ Power setting) 


- 


- 

4 

: 45 

13 ; 45 


Depth of planning was measured by an online questionnaire 
technique ■ . As the flight proceeded, the pilots received verbal 
queries concerning the depth of planning associated with the 
present and future flight phases and the three selected subtasks 
for each flight phase. These queries were presented in a random 
order. 

The flight task of the pilots should be disturbed as little as 
possible by the online questionnaire. Therefore, the pilots were 
thoroughly familiarized with the complete questions and possu.jle 
responses during the instructions before the flights (see Appen- 

"k \ 

dices D and E ') . During the experiments, they only heard the short 
names of the flight phases and subtasks, e.g., "Final Approach", 
"Cruise",. or "Track Intercept", "Crosswind". The answers were 
coded by numbers which were the only verbal responses of the 
pilots. 

In Experiment I, the pilots responded with a verbal rating on a 
5-point scale of depth of planning (see Table 2, and Appendix E 
for the actually used German version) . 


All instructions, ratings, and questionnaires actually used 
ih the experiments were in German (see Appendix E) . 
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Table 2; Questionnaire for depth of planning 


p 

•H 


fd 

H 

CM 

iW 

O 

Xi 

4J 

ft 

0) 

Q 



To what extent are you planning with 
respect to the flight phase or subtask? 

1 

not at all 

2 

generally aware of task 

3 

overall qualitative assessment only 

4 

specific information needs 

5 

considering specific actions 


The associated text explanations for the possible responses 
in Table 2 only served as an aid for getting a feeling for 
the scale. The queries normally occurred every 30 seconds 
with air traffic and navigation?,! information supplied in 
the intervals (see Appendices B and C) . If a depth rating 
indicated a detailed level of planning (i.e., 4 or 5) , more 
specific queries concerning all three associated subtaskii of 
that flight phase followed immediately, delaying the next 
query on another flight phase. 

In Experiment II, depth ratings were made using a 10-point 
scale (see Appendices D and E) . This change was made to 
lessen the occasional "chattering" between, e.g., ratings 
of 2 and 3 as obtained in the first experiment with the 
5-poin.t scale. Depth ratings were only made for flight phases 
4, 5, and 6 (Initial Approach, Pinal Approach, and Landing) 
in the second experiment. These 3 phases with their 9 sub- 
tasks constituted a set of 12 possible queries to the pilot. 
All queries were randomly and independently chosen from the 
set of 12, with the exception that the 3 flight phases were 
twice as likely to be chosen as the 9 subtasks. Queries 
occurred every 20 seconds with air traffic and navigational 
information supplied in the intervals. Thus, with 20 minute 
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flights and 3 questions per minute, there were 60 questions 
per flight, 8 for each flight phase and 4 for each subtask. 

For the data analysis, two measures for depth of planning 

were derived from the raw data; average depth and frequency 

of depth above threshold. The mean D was calculated as the 

average depth. The frequency measure has been defined as 

p(D § ' i.e./ the number of depth ratings D which were 

above a certain threshold were counted. 

o 

2.4.2 Probability of Increased Difficulty and Criticality 

The probability of increased difficulty has been hypothesized 
to be one of the independent variables affecting depth of 
planning (see Section 2.4.1). This variable was also measured 
by an online questionnaire technique. The pilots were asked 
to rate the probability of increased difficulty of the task 
just mentioned, given the current situation and state of the 
aircraft. They only heard the short name "increase of diffi- 
culty" for the queries which followed immediately after the 
pilots responded to depth of planning. The answers were also 
coded by numbers of a 5-point scale (see Table 3 and Appen- 
dix E) . The probability of increased difficulty was not 
measured during the second experiment because of its high 
correlation with depth of planning (see Section 3.1.2). 

Table 3; Questionnaire for probability 
of increased difficulty 



Expected increase of difficulty? 

1 

none 

2 

minor 

3 

moderate 

4 

considerable 

5 

very considerable 
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Data for criticality, another independent variable of depth 
of planning, were collected off-line by using separate sub- 
jective scales for all flight phases and subtasks. The pilots 
were asked; "How important is each of the following flight 
phases and subtasks relative to the accomplishment of the 
overall mission?" An excerpt of the subjective scales for 
criticality assessment, which had to be cross-marked by the 
pilots, is shown in Figure 2, The order of the flight phases 
and subtasks for the complete set of scales is the same as 
that shown in Table 1 for the timeline (see also Appendix E) . 

The mean C was calculated as the average criticality for the 
data analysis. 


completely very 

unimportant important 


.. 4. Initial Approach 

4.1 Flaps 

4.2 Localizer intercept 

4.3 Glideslope intercept 

Figure 2; Excerpt of subjective scales for criticality 

2.4.3 Workload 

Dependent variables in the experiment included not only depth 
of planning but also workload and performance. After each 
flight of approximately 20 or 32 minutes, the pilots esti- 
mated their experienced workload, separately for each of the 
flight phases. They used appropriate subjective rating scales 
[Johannsen, Ffendler, and Stein, 1976; Pfendler and Johannsen, 
1977], similar to those for criticality, which had to be 
cross-marked. The subjective workload scales are shown in 
Figure 3 and Appendix E. 

The mean W was calculated as the average workload for the data 
analysis. Strictly, nonparametric statistics would be more 
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Pilot; 


No . ; Date ; Time : 


How strongly did you feel subjectively strained by the work 
load? 

Please, give the answers separately for the 7 flight phases by 
cross-marking the following scales. 


Cruise 

Descent 








very low 
effort 

low 

effort 

medium low 
effort 

medium 

effort 

medium high 
effort 

high 

effort 

very high 
effort 

very low 
effort 

low 

effort 

medium low 
effort 

medium 

effort 

medium high 
effort 

high 

effort 

very high 
effort 

Holding 

Initial Approach 

very low 
effort 

low 

effort 

medium low 
effort 

medium 

effort 

medium high 
effort 

high 

effort 

very high 
effort 

very low 
effort 

low 

effort 

medium low 
effort 

medium 

effort 

medium high 
effort 

high 

effort 

very high 
effort 

Final Approach 

very low 
effort 

low 

effort 

medium low 
effort 

medium 

effort 

medium high 
effort 

high 

effort 

very high 
effort 
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Figure 3; Subjective workload scales 


appropriate but the pragmatic approach followed here seemed to 
be feasible. This argument has been adopted for the analysis 
of all data from online questionnaires and off-line subjective 
scales, i.e., for depth of planning D, criticality C, and work- 
load W. 
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2.4.4 Performance 


Extensive objective flight performance data was collected. 

The first approach was to consider seven performance tole- 
rances, Two tolerances related to glideslope and localizer 
deviations at a height of 200 ft. The remaining five tole- 
rances concerned touch down and included; longitudinal posi- 
tion, lateral position, sink rate, bank angle, and pitch angle. 
The measure "number of performance tolerances exceeded" was 
evaluated only for Experiment I. Its drawback is the fact that 
an assessment of performance is only given for the two flight 
phases Final Approach and Landing. 


No single measure of performance seemed appropriate for the 
entire flight. However, the pilot’s control signals in terms 
of elevator, aileron, and rudder angles can be viewed as in- 
direct measures of performance. This is similarly true for 
the attitude signals in terms of pitch and roll angles. 
Certainly, any deviation from the desired flight path has to 
be corrected by using one of these controls and changing the 
attitude of the aircraft. However, these controls vary even 
for flights that stay exactly on the desired flight path. Thus, 
a baseline is needed with which to compare measures of control 
activity and attitude. A good choice is to use the same meas- 
ures applied to the autopilot's activities as a baseline. 


As a result of this consideration and after some experimen- 
tation with data mainly from the first experiment (see below) , 
the square roots of sums of variances, with respect to time- 
varying means, integrated over flight phases j and divided 
by their time duration Tj were chosen as scalar performance 
measures for both, control actions (o^) and attitude (o^) , 
e.g., for control: 


t . +T . 


^C, " T. 




(t) + 


olit) 


a? (t) 


( 1 ) 


t=t. 


OD 
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The variance for a particular control Uj^(t) over a time 
window of length T = 10 a is given by the equations; 


[Uj^(T) - u^(t) ]^, (2) 


(3) 


elevator, aileron, and rudder angles 
was taken for control actions. The variances of pitch and 
roll angles were calculated using equations similar to those 
above and summed for the attitude measure o, . 

Aj 

Some experimentation with the performance data was undertaken 
before deciding to use the above equations. The RMS-values 
(root-mean-square) were compared with the a measures as shown 
in Equation (1). This was done graphically. In case of the o 
measures, the square root from Equation (1) was illustrated 
as a function of time. Examples are shown in Figures 4 anu 5 
where the manual control activity (Fig. 5) has been contrasted 
with the autopilot's activity as a baseline (Fig. 4). It can 
be seen that the latter has been much more strongly determined 
by the. flight course. The area under the curve corresponds to 

the measure of Equation (1), e.g., = I4/AT4 (see Fig. 5). 

^4 

The comparison between the a measures and the RMS-values 
showed that the inclusion of the means which are determined 
by the flight course was misleading in case of the RMS-values, 
especially as these are also included in the baseline activi- 
ties with autopilot. 


T 


O^t) 


I 


Tst- 


T 


T = t+^ 


Si(t) = i 2 


T = t- 


T 


The sum of variances of 
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Another experimentation v/as concerned with the length of 
the time window; see Equations (2) and (3). It was varied 
with the values T « 10 s, 20 s, and 30 s. The results showed 
that the averaging effect was too strong with the longer 
time windows. 

The last experimentation with the data tried to explore 
whether a measure without averaging the control and attitude 
signals would be more appropriate. Instead of Equation (2) , 
the following functions were calculated; 

u^i(t) = [u^(t) - Uj^(t)]2 (4) 

where u^(t) is the mean over T « 10 s as in Equation (3). 
Then, the following performance measure for the control 
actions during the flight phases 3 was taken, as opposed to 
Equation ( 1 ) : 



(5) 


The attitude measure A, was calculated similarly. The 
difference between these A measures and the o measures as 
shown in Equation (1) will be discussed in Section 3.2.2. 

An additional measure was calculated for the "Pinal Approach" 
which was the combined RMS-value of the localizer and glide- 
slope (LOC/GS) deviations. The purpose of this measure was 
to consider the real errors observed during this flight phase. 
A comparison with the o^ measure can also be found in 
Section 3.2.2. 
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2,5 Exporlmonts 

2.5.1 Pilot Study 

The oxporimontal studios have boon accomplishod in three 
parts, i,o,, a pilot study, Experiment I, and Experiment II. 
In this section, some general information and the experi- 
mental designs will bo given. The experimental procedures 
will be described in Appendix C. 

First, a pilot study utilizing 3 subjects was performed to 
test the feasibility of the flight scenarios and question- 
naires. Several modifications were made during and after 
these tests concerning the flight simulator, the aquisition 
of performance data, the procedures and instructions for 
the flight scenarios, the questionnaires, and the computer- 
aiding for the experimenter handling the online queries, 

2.5.2 Design of Experiment I 

Another 3 subjects participated in Experiment I. During these 
flights, data on the planning process, probability of in- 
creased difficulty, and flight performance as explained in 
Section 2.4 were collected. The treatments for the 3 subjects 
were the 3 flight scenarios which are described in Section 
2.3, i.e.^ normal (N) , abnormal (A), and emergency (E) . 

With one repetition per flight scenario, a replicated Latin 
Square design resulted. The experimental design actually 
used is shown in Table 4 . It deviates from the Latin Square 
design by the additional tests T^(Nq^) and Tg(NQ 2 )* These 
tests were introduced as a reference for the basic flight 
scenario without online questionnaires, thereby allowing 
evaluation of the extent to which the questionnaires dis- 
turbed the pilots. The basic flight scenario itself was not 
changed for all tests Nq^ , Nq 2 , , and N 2 » The other flight 
scenarios (A^ , A 2 , , and E 2 ) were those explained in 

Sections 2.3.2 and 2.3.3. In both abnormal situations, A^ and 
A 2 , the autopilot was used whereas all other flights were 
flown manually. 
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Table 4s Experimental Deoign for Experiment I 


Tests 









Subjeets\^ 



^3 

'^4 


•^6 


■'a 


^01 

A^ 



^02 


^2 

»2 

®2 

«01 

E>j 

«i 


»02 

«2 

^2 

h 

^3 

«01 


A^ 

E<| 

^02 

^2 

N 2 

®2 


2.5.3 Design of Experiment II 

Three other subjects participated in the Experiment II. 
During the flights/ depth of planning and flight performance 
were measured as explained in Section 2.4, The treatments 
for the 3 subjects were the 5 flight scenarios N, / A 2 / 

/ E 2 which are described in Section 2.3, combined with 2 
levels of automation, i.e,, mar?»’al (M) and autopilot (A). 

The 5x2 factorial experimental design actually used is 
shown in Table 5 with tests through T^q. The test T^-j was 

Table 5; Experimental design for Experiment II 


Tests 

SubjectsNs^^^ 

m m fTi m m 

•‘•1 ■‘•2 ^3 •^4 ^5 

rp m m m tn 

^6 ^7 -^8 ^9 ^10 

Ti ^ 


^1A ®1M ^2A ®2M 

^A ^1M ^1A ^2M ^2A 

“m 

®2 

% ®1A ^1M ®2A ^2M 

\ ^1M ^1A ^2M ^2 A 


S3 

% ^1A ^1M ^2 A ^2M 

”^A ^‘1M ^1A ^2M ^2A 
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adidod in order to investigate the influence of multi- 
ovontB (MB) during manual flight control (M) , This Bconario 
was a combination of the scenarios E^/ and B 2 . An engine 
failure (B^) occurred at 4,2 minutes into the '’light, fol- 
lowed by a runway closure (A^) at 5.2 minutos and a hydraulic 
failure (Eg) at 7.5 minutos (see also Appendix D.2.3). 

3 . Results 

3 . 1 Experiment I 

3.1.1 Depth of Planning, Workload, and Performance 

Tables 6 and 7 summarize the overall results of Experiment I, 
While the abnormal scenarios (A^ and Ag) resulted in the 
highest average depth oi planning (b) and the largest value 
of p(D S 4), the emergency scenarios (E^ and Eg) resulted 
in the highest average workload (W) ar.a largest values of 
and o^. Prom these results, one might conjecture that ab- 
normalities require more planning than emergencies, perhaps 
because there are usually fixed procedures for dealing with 
"standard" emergencies while procedures for coping with ab- 
normalities are typically more ambiguous. Unfortunately, in 
Experiment I the differences between abnormal and emergency 
scenarios were confounded with the use of autopilot for the 
abnormal scenarios and manual control for the emergency 
scenarios. Thus, it might be that the higher workload due 
to manual control during the emergencies precluded planning. 
This confounding of independent variables was eliminated ^n 
Experiment II. 

Considering the differences among flight phases (Table 7) , 
it appears that Initial Approach, Final Approach, and Landing 
are most interesting from a combined perspective of D, c, and 
W. This result motivated the change in Experiment II such 
that depth of planning queries were only made for these phases 
and their subtasks. In this way, more measurements were ob- 
tained for the most interesting aspects of the flight. 
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Table 6: Results vs, scenario for Experiment I 


SCENARIO 

D 

p(D^4) 

W 



^01 

- 

- 

3.51 

0.62 

2,05 

"i 

2.25 

.057 

3.60 

0.75 

2.36 


2.72 

.201 

3.30 

0.39 

1.32 


2. 15 

.094 

4.61 

1.13 

3.05 

^02 

- 

- 

3.24 

0.75 

2.24 


2.41 

.078 

3.87 

0.71 

2.15 

^2 

2.69 

.183 

2.62 

0.45 

1.25 

^^2 

2.29 

.107 

4.03 

0.91 

2.68 


Table 7: f^esults vs. flight phase for Experiment I 


FLIGHT PHASE 

D 

p(D^4) 

C 

W 

"c 

^A 

Cruise 

2.50 

.125 

5.21 

1.43 

0.44 

1.33 

Descent 

2.42 

.034 

6.02 

2.22 

0.39 

1.47 

Holding 

2.^4 

.086 

5.54 

2.65 

0.51 

2.15 

Initial App. 

2.69 

.064 

7.13 

3.30 

0.84 

3.39 

Final App. 

2.78 

.183 

8.37 

5.05 

0.65 

1.63 

Landing 

2.42 

.130 

8.48 

6.30 

1.37 

2.72 

Ground Ro] 1 

1.71 

.081 

5.92 

4.63 

- 

- 

Cruise to Alt. 

3.60 

.600 

7.82 

- 

- 

- 
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3.1.2 Relationships Mionq Measures 

In an attempt to determine whether or not D, C/ W, etc. were 
unique measures , the correlation between each pair of meas- 
ures was calculated. Using the results in Table 6, three sig- 
nificant (p<,05) correlations were found; W and (r=.863); 

W and (r=.877); and o^^ and (i = .978). For the results 
in Table 7, there were two significant correlations; c and 
W (r=.831) and W and (r=.851). While the other correla- 
tions among C, W, and were all reasonably large, the 
small number of degrees of freedom associated with the highly 
aggregated measures in Table 7 made p<.05 difficult to achieve. 
A more fine-grained correlation analysis was performed for 
Experiment II and is discussed in Section 3.2.2, 

It is particularly interesting that 6 was not significantly 
correlated with C, W, o^, or a^. This result is certainly 
consistent with the discussion in section 3.1.1. A possible 
explanation for this result will be provided in Section 4.1. 

The correlation between depth of planning and probability of 
increased difficulty was found to be r=.601 (p<.01). This 
result as well as logistical reasons dictated the decision 
to omit probability of increased difficulty as a variable in 
Experiment II. 

3.1.3 Time Histories of Depth of Planning 

Considering the six scenarios that included depth of planning 
assessments, eight flight phases, and three pilots, well 
over 100 time histories of depth of planning were collected. 
However, as noted in Section 3.1.1, depth of planning was 
greatest for the abnormal scenarios (A^ and A 2 ) . Therefore, 
in the interest of brevity, discussion of the time histories 
of depth of planning will be limited to those of one pilot 
for the A^ and A 2 scenarios. These time histories are shown 
in Figures 6 and 7 for the flight phases Initial Approach, 

Final Approach, and Landing. 
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Figure 7: Depth and difficulty ratings for a) Initial Approach, 
b) Final Approach, and c) Landing for A 2 
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For the time histories shown in Figures 6 and 7 which are 
reasonably typical, a few straightforward conclusions are 
possible. First, as pointed out in the correlation analyses 
(Section 3.1.2), depth of planning is highly correlated 
with probability of increased difficulty. Although, ad- 
mittedly, this relationship may have been significantly in- 
fluenced by the pilot having to provide depth and difficulty 
ratings at the same instant. On the other hand, depth of 
planning appears to have been only weakly related to criti- 
cality. Perhaps a criticality measure conditioned on partic- 
ular events (e.g., snow) might be a better predictor of depth 
of planning. Nevertheless, the results for difficulty and 
criticality noted in this paragraph led to their receiving 
much less emphasis in Experiment II. 

Considering planning as it is affected by the time remaining 
until the flight phase in question begins, Figures 6 and 7 as 
well as many other time histories lead to a particularly 
interesting conclusion. There appears to be two types of 
planning; event-driven and time-driven. Event-driven planning 
is evidenced by increases in depth in response to events such 
as the report of "snow - runway closed" for in Figure 6. 
Time-driven planning occurs as the flight phase of interest 
is approached, as shown in four of the six time histories 
in Figures 6 and 7. 

The differences between event-driven and time-driven planning 
might be characterized by defining time-driven planning as 
monitoring the following of a script while event-driven 
planning reflects the updating of thei script because of an 
unanticipated situation. This conceptualization be considered 
in more detail in Sections 3.2.3. and 4.1. 

3.2 Experiment II 

As noted in Section 2.5.1, Experiment II was the third of a 
three-part series of experimental investigations. As such. 
Experiment II was carefully designed to test the hypotheses 
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and conjectures which emerged from the pilot study and 
Experiment I, Consequently, the analysis of the data from 
Experiment II was much more rigorous and fine-grained. The 
results to be presented in the following sections are based 
on Analysis of Variance and, when multiple comparisons are 
discussed, Duncan's Multiple Range Test (see, e.g., [Afifi 
and Azen, 1972; Montgomery, 1976]). 

3.2.1 Depth of Planning, Workload, and Performance 

Tables 8 through 1 1 summarize the overall results of Experi- 
ment lit These results were calculated for the period start- 
ing at 4.0 minutes into the flight and ending 14.5 minutes 
into the flight. Two reasons motivated this choice of time 
period: 1 ) prior to 4.0 minutes, all flights were equivalent 
except for the availability of autopilot, 2 ) after 14.5 minutes, 
the abnormalities and emergencies inherently differed because 
the abnormalities were resolved (i.e., "runway open") while 
the emergencies were not. 

Average depth of planning (D) was significantly affected by 
scenario as shown in Table 8 (F^ = 4.22, p < .005). Multiple 

comparisons indicated that the N scenario differed signifi- 
cantly from the other four scenarios which were similar in 
terms of D. The results for p(DS 8 ) were similar to those for 
D = 5.18, p < .005). 

Average workload (W) was significantly affected by scenario 
^^4,60 "" ^ .42, p < .001) with the A^ and A 2 scenarios prod- 
ucing ‘lower W than the N, E^ , and E 2 scenarios (Table 8 ) . 

and were also significantly affected by scenario (F^ 60 “ 
6.15, p < .001 and F^ = 8.35, p < .001, respectively) 
with the E- scenario producing larger values of o and 0 _ 

' w A 

than the other four scenarios (Table 8 ) . 

While 6 and p(D^ 8 ) did not significantly differ for the three 
flight phases, W, o^, and were significantly affected 
^^2,60 P < *001; ^2,60 ^ p < .001; and 
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Table 8: Results vs. scenario for Experiment II 


SCENARIO 

D 

p(D&8) 

W 



N 

4.82 

.059 

4.34 

0.75 

1.95 


6.54 

.378 

3.83 

0.73 

1.66 


6.08 

.323 

3.83 

0.87 

2.19 

■^1 

5.79 

.325 

5.85 

1 .45 

4.39 

^2 

6.64 

.470 

5.12 

0.72 

2.23 


Table 9: Results vs. flight phase for Experiment II 


PLIGHT PHASE 

W 


•^A 

Initial App. 

3.95 

0.76 

3.21 

Final App. 

4.53 

0.64 

1.76 

Landing 

5.30 

1.30 

2.49 


Table 10: Results vs. automation for Experiment II 


AUTOMATION 

W 

°A 

Manual 

Autopilot 

4.87 

4.31 

2.87 

2.10 


Table 11: Depth of planning vs. scenario and automation 
for Experiment II 


SCENARIO 

AUTOMATION 

D 

P(DS8) 

A 

Manual 

6.91 

■■ 

E 

Manual 

5.79 

mm 

A 

Autopilot 


.198 

E 

Autopilot 


.522 
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^2,60 = 5.19, P < .005; respectively). More specifically. 
Landing produced significantly higher W and o^ than the 
other two phases. However, o^ was higher for Initial Approach 
than for the other two phases. These results are shown in 
Table 9 . 

The main effect of level of automation was only significant 
for W and ^^1,60 " 4.51, p < .05 and = 5.28, p < .05, 

respectively). As shown in Table 10, manual control resulted 
in higher W and o^. The interaction of scenarios and level of 
automation significantly affected p(D^8) and, if the N sce- 
nario was omitted from the analysis, 5 was similarly affected 
^^4,60 “ 4.54, p < .005 and = 2.99, p < .05, respec- 

tively). Table 11 illustrates the nature of this interaction. 
The basic result is that abnormal scenarios with manual con- 
trol and emergency scenarios with autopilot were similar in 
terras of producing larger values of both 6 and p(D^8) than 
resulted with abnormal scenarios with autopilot and emergency 
scenarios with manual control. A possible explanation of this 
interesting interaction will be discussed in Section 4.1. 

3.2.2 Relationships Among Measures 

The results of the correlation analyses for Experiment I that 
were presented in Section 3.1.2 motivated a detailed study 
of the relationships among measures using the data from Ex- 
periment II. The correlations of 5 with W, o^, and were 
determined on the basis of 90 measurements (5 scenarios, 

3 flight phases, 2 levels of automation, and 3 subjects). The 
only significant (p<.05) correlation was between D and W 
(r = .377) . 

The correlations of W with and o^, with o^, with 
o^, and A^ with were determined on the basis of 150 meas- 
urements (i.e., for 5 flight phases rather than 3). All of 
these correlations were significant; r = .562 for W- and Op, 
r = .489 for W and o^, r = .820 for and o^, r = .977 for 

Aq and r = .943 for A^ and o^. Clearly, the four 

performance measures o^, A^, and A^ are highly redundant. 
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The redundancy was also true of localizer and glideslope 
deviations which were significantly correlated with a^(r=,861). 

3*2.3 Time Histories of Depth of Planning 

Figures 8 through 14 present time histories of depth of 
planning averaged across subjects, levels of automation, and 
similar scenarios (i.e., each point is an average of six 
measurements for normal scenarios, twelve measurements for 
abnormal and emergency scenarios, and three measurements for 
the multiple event scenario).. Figures 8, 9, and 10 are the 
time histories for the flight phases Initial Approach, Final 
Approach, and Landing, respectively. Perhaps the most distin- 
guishing feature of this time histories is the consistent 
way in which all four types of scenarios have similar values 
of D for the early and later portions of the flight, but 
during the middle portion cf the flight, abnormal, emergency, 
and multiple event scenarios have consistently higher values 
of D. This provides further evidence for the dichotomy intro- 
duced in Section 3.1.3, namely, event-driven and time-driven 
planning. Specifically, the abnormal and emergency "events" 
cause increased planning until time-driven planning pre- 
dominates as the flight phase of interest becomes closer. 

This effect is greatest for the multiple event scenario. 

While one might expect the abnormalities and emergencies to 
have different effects on depth of planning, the results pre- 
sented in Section 3.2.1 do not support this hypothesis and 
there is no evidence for such a differential effect in 
Figures 8, 9, and 10 with the possible exception of the mul- 
tiple event scenario. However, the time histories of depth 
of planning for the subtasks "Weather minima" and "Runway 
condition", shown in Figures 11 and 12, do exhibit this 
effect. This difference is clearly due to the fact that the 
abnormalities, which also occurred in the multiple event 
scenario, involved inclement weather while the other scenarios 
did not. Apparently, the measure of depth of planning for the 
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Figure 14: Average depth of planning for Glideslope Intercept 


overall flight phases is not sensitive enough to discriminate 
among types of event# at least when averaging across subjects, 
levels of automation, and similar scenarios. 

Figures 13 and 14 show the time histories of depth of planning 
for the subtasks "Localizer intercept" and "Glideslope inter- 
cept" . 'The planning reflected in these time histories is clearly 
time-driven and not affected by differences in scenarios. These 
results serve to point out that planning with respect to some 
subtasks may be unaffected by abnormal or emergency events; 
those subtasks may be viewed as purely time-driven. 

4 . Discussion and Conclusions 
4 . 1 Summary of Important Results 

While a variety of interesting empirical results have emerged 
from the studies reported here, three results deserve special 
emphasis in this section. The first result of particular interest 
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io tho identification of the dichotomy between event-driven 
and time-driven planning. It appears that event-driven 
planning can be doocribed as updating a script or creating 
a new script while time-driven planning involves monitoring 
the execution of a script. The time histories of depth of 
planning presented in Sections 3.1,3 and 3,2,3 support this 
description in that the abnormalities and emorgencieo mainly 
affected the event-driven portions of the time histories. The 
time-driven portions were not differently affected by the 
scenarios because the plan had already been updated to reflect 
the abnormalities and emergencies. 

The second result of interest is the way in which depth of 
planning was affected by the interaction of scenario and 
level of automation in Experiment II, Why does the availa- 
bility of autopilot result in decreased planning during ab- 
normal scenarios and increased planning during emergency sce- 
narios? While one might postulate this effect to be a by-pro- 
duct of the lower workload during the abnormal scenarios, the 
low correlation between depth of planning and workload does 
not support this hypothesis. 

This unusual effect of autopilot on depth of planning can 
perhaps be explained by the nature of the abnormal and emer- 
gency scenarios. The abnormalities involved changes in the 
environment (i.e. , runway closure due to snow or fog) while 
the emergencies involved changes within the aircraft (i.e., 
engine failure or loss of hydraulic pressure) . Despite these 
differences, the average depths of planning were remarkably 
similar, averaging 6.31 and 6 22 for abnormal and emergency 
scenarios, respectively. Yet, the autopilot did have a dif- 
ferential effect on planning. 

One can conjecture that the key to explaining this somewhat 
counterintuitive result is the effect of the autopilot on 
the types of event. The autopilot controls the aircraft but 
not the environment. Therefore, the autopilot can help to 
compensate for events within the aircraft but cannot directly 
affect events in the environment. Thus, when an engine failure 
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or loss of hydraulic pressure occurs, the autopilot can 
help to compensate and thereby free the pilot to plan the 
course of actions necessary to deal with the failures. As a 
result, the availability of the autopilot during such emer- 
gencies results in increased planning. 

In contrast, abnormal situations such as the runway closures 
used in these experiments result in the pilot's main task 
being holding and waiting. While some planning might be 
associated with the possibility of diverting to an alternate 
airport, this possiblity v/as not heavily stressed in these 
experiments. Thus, the planning that is necessary mainly 
involves the ‘'holding" task. However, if the autopilot is 
available, it performs much of this task and, as a result, 
the pilot's planning decreases. 

To summarise the conjecture offered here, during emergencies 
the autopilot frees the pilot to devote more time to planning; 
during abnormalities the autopilot assumes a significant por- 
tion of the task and lessens the need for planning. While this 
notion is somewhat speculative and needs further investigation, 
it does serve to emphasize the possible subtle effects of 
automation , 

The third result of particular interest is the low correlation 
between depth of planning and workload or flight performance. 
While the fair to high correlation between workload and control 
activity agrees with one's intuition, the fact that an in- 
creased need for planning did not greatly affect perceived 
workload is rather counterintuitive. It is quite possible that 
the pilots perceived workload in terms of having to do some- 
thing and, since planning is an internal activity, they did 
not associate planning with work or effort. Alternatively, 
this result can be viewed as evidence that workload is a 
multidimensional concept that cannot be reduced to a scalar 
metric. Prom this perspective, the human information pro- 
cessing associated with the tracking task of flight control 
should be viewed as quite different from the information pro- 
cessing associated with planning. 
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4.2 Im plications of Results 

The results presented in this report have both methodolo- 
gical and theoretical implications. From a methodological 
point of view, the inflight questionnaire techniques de- 
veloped for this research, as well as the pre-experiment 
and post-experiment questionnaires utilized, provided a 
variety of insights into human planning behavior that would 
not have been gained if only traditional performance and 
workload measures had been assessed. Indeed, the results of 
the correlation analyses reported here indicate that such 
traditional measures relate only weakly, if at all, to 
planning behavior. 

While the assessment of depth of planning does surfer from 
being only an introspective report, this limitation is by 
no means as severe as encountered V7ith verbal protocols 
because depth is measured quantitatively and can therefore 
be subjected to various statistical tests that account for 
experimental error. Of course, this increased rigor comes 
at a price of losing some of the richness of verbal proto- 
cols. One possible avenue of future research would be to 
utilize a mixture of the two methods. 

Considering theoretical implications, perhaps the most im- 
portant aspects of this research relate to the dynamic, un- 
certain aircraft domain which was studied. Planning was 
driven by the both the onslaught of time and the ^iccurrence 
of unanticipated events. In this respect, the aircraft 
domain is quite different from the restaurants [Schank and 
Abelson, 1977] and shopping trips [Hayes-Roth and Hayes-Roth, 
1979] studied by other investigators of planning. 

As a result of this difference, the aircraft dom^'n pro- 
vided evidence for both hierarchical, time-driven following 
of scripts and opportunistic, event-driven planning. Thus, 
both extremes of hierarchical and heterarchical planning are 
useful for describing human planning behavior in complex. 
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dynamic environments. Based on this conclusion, the next 
phase of this .research should focus on integrating the for- 
malized models cf planning proposed by the researchers dis- 
cussed in the Introduction. 


4 . 3 Conclusions 

This report has presented a methodology for studying planning 
behavior of aircraft pilots and discussed an application of 
this methodology within two very realistic flight experiments. 
Beyond showing that the methodology yields consistent results, 
these experiments also produced new concepts in terms of the 
dichotomy between event-driven and time-driven planning, the 
subtle effects of automation on planning, and the relation- 
ship of planning to workload and flight performance. 
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APPENDICES 



A. HFB-320 Simulator 


A. 1 General Description 


The simulated aircraft type used in this study was a twin 
engined HPB<-320 Hansa Executive Jet manufactured by Messer- 
schmitt-BSlkow-Blohm, Hamburger Flugzeugbau. An original 
mockup of the manufacturer including the primary flight con- 
trols and consoles was fitted with a typical instrument 
arrangement for category II operation (Decision hight 100 ft, 
Runway Visual Range 1,300 ft). Although the HPB-320 is flown 
with a two-man crew, it was decided to omit the co-pilots 


flight ihstruitehts in this research flight simulator in 


order to allow a greater flexibility in various investigations. 

r' 


The flight simulator allows full maneuverability and is de- 
signed to have a high quality of realism during approaches 
using a simulated instrument landing system (ILS) . It is 
fixed base, provides simulation of turbulence weather con- 
ditions and has no visual simulation system of the outside 
view. An autopilot and flight director system is provided to 
permit automatic control of the aircraft in its three axes. 


Additionally, the simulator has a feature known as Control 
Wheel Steering (CWS) or Force Wheel Steering to allow the 
pilot to enter the automatic control loops in all modes of 
autopilot operation. This is done by adding force sensors 
to the pilot's control wheel plus installing a force wheel 
steering coupler to the autopilot system. 

The signals of the primary flight controls (elevator, aileron, 
rudder) and the secondary flight controls (i.e., all primary 
control surface trim systems, wing flaps, leading edge slats, 
speed brakes) are inputs to the mathematical model of the 
aircraft stored in an EAI 640 computer. This is a small dig- 
ital computer having a capacity of 16 k of 16 bit words.. The 
real-time simulation progroun is updated every 40 ms [Holzhausen 
and Kiihne, 1974] . 
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An Interface consisting of three 19’’ cabinets serves as a 
signal processor between the computer and the cockpit. The 
horizontal situation of the aircraft is computed within a 
range of 65 km x 65 km. This area should be seen as a digital 
stored "map" including a true-map grid system. The resolution 
is 1 m s 1 bit. The localizer of the software-installed in- 
strument landing system is placed in the origin of the co- 
ordinates. Approaching this IhS , the localizer course is 250° 
and the inclination angle of the corresponding glideslope is 
3.1°. The ILS-markers OM (Outer Marker) and MM (Middle Marker) 
are part of the digital "map", too. 

There is a 2--pen x-y plotter recording both lateral and ver- 
tical flight path which provides on-line monitoring plus hard- 
copy availability of the flight mission to the experimenters. 

The horizontal coverage of the plotter is 20 km x 32 km. The 
vertical area corresponds to the range of typical radio alti- 
meters (2,500 ft). Figure 1 is a plot of a vectored ILS-approach 
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flight mission with a 310® localizer inbound course (plan 
view of the INITIAL APPROACH ) , glideslope capture in the 
vicinity of the outer marker (OM) , and the final approach 
at the flight base line. The upper curve (side view) is the 
reading of the radio altimeter descending from 7,000 ft (out 
of range) to 1,500 ft (HOLDING ALTITUDE), and shows finally 
the tracking of the glideslope, 

A. 2 Capabilities and Limitations 

The main article of equipment in the flight simulator is a 
real Collins AP-104/FD 109 H autopilot and flight director 
system. This system consists of several black boxes housed in 
the interface cabinets , three autopilot servos to operate the 
primary flight controls of the simulator, the trim indicators, 
and finally the controls and displays as part of the pilot's 
equipment in the cockpit [Collins, 1968]. 

The displays are the flight director indicator (PDI) and the 
course indicator (Cl) . They are installed in the center field 
of view at the pilots side of the instrument panel (Figure 2) . 
The flight director indicator (FDI) provides a quasi-3-dimen- 
sional display of aircraft attitude and steering commands. 
Pitch and roll attitudes are displayed by the relationship 
of a fixed aircraft symbol to the movable attitude tape. Both, 
vertical and lateral steering information are derived from 
the resident flight computer of the system. To fly on the 
proper flight path, the pilot's input to the flight controls 
has to align the command bars (V-bars) to the fixed aircraft 
symbol positioned in the center of the instrument. The FDI 
also includes a runway symbol (corresponding to localizer 
deviation and radio altitude) , a glideslope indicator, a rate- 
of-turn indicator, and the annunciator lights for go-around 
and the minimum decision altitude (MDA) . 

A fixed airplane symbol on the course indicator (Cl) shows 
airplane position and heading with respect to the azimuth 
card, lateral deviation bar, and selected heading. The lateral 




Figure 2 : Instrument panel, flight controls, and pedestal 


deviation bar repxesents the center line of the selected 
VOR-course (Very high frequency Omnidirectional Range) or 
localizer course. However, there is no simulation of VOR or 
NDH (Non Directional Beacon) included in the HFB-320 simu- 
lator. Thus, the localizer is the one and only instrument 
navigation facility in this configuration. Aircraft position 
above or below the glideslope is shown by the position of 
the glideslope pointer of the Cl in relation to the center 
line of a glideslope scale. The pointer and scale repeat the 
glideslope indication given by the flight director indicator. 


There are a couple of autopilot/flight director system warn- 
ing flags in the FDI and Cl to indicate a malfunction of the 
associated subsystem. Limited system operation is possible 
with only some of the flags in view. If, for example, HEADING 
and GYRO flags are in view (indicating a failure of compass 
and vertical gyro system) , the localizer information will be 
still correct and usable. 
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TO supply mode and command functions for the autopilot and 
flight director system there are an autopilot controller and 
a mode selector installed in the pedestal of the cockpit. 

The autopilot controller provides turn and pitch command 
knobs for the manual control mode of the autopilot. An engage 
lever engages or disengages the autopilot servo clutches to 
or from the control surfaces. Additionally, there is an auto- 
pilot manual switch to couple or uncouple the flight director 
to the autopilot. The mode selector enables the pilot to se- 
lect various lateral or vertical (or any combination) modes 
of the flight director. Table 1 is a listing of the modes of 
the flight director either coupled or uncoupled to the auto- 
pilot. 

Table 1 : Plight control system modes 

Lateral Modes Vertical Modes 


ROLL 


maintains roll 
attitude 

PITCH 

maintains 

pitch attitude 

HEADING 


maintains selected 
heading 

IAS 

maintains 

indicated airspeed 

VOR/LOC 


tracks VOR-radial 
or localizer 

VS 

maintains 

vertical speed 

APPROACH 

I 

tracks ILS Cat, I 

ALT 

maintains 

altitude present 

APPROACH 

II 

tracks ILS Cat. II 


at the time of engagement 


Consequently, there are four basic modes to fly the aircraft: 

I . Manual Mode 

The autopilot is disengaged and the flight director 
is turned off. The pilot has to use the primary flight 
controls. 

II . FD-Manual Mode 

The autopilot is disengaged and the flight director 
is active. The pilot uses the primary flight controls 
to follow the command display. 
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III. AP~Manual Mode 

Tho autopilot is ongagod and the flight director is 
uncoupled from the autopilot. The pilot has to use 
tho turn- and pitch-command knobs to control the 
aircraft. Selecting Control Wheel Steering (CWS) is 
possible, too. 

IV. Automatic Mode 

The autopilot is engaged and the flight director is 
coupled to the autopilot. The pilot monitors opera- 
tion of the flight control system. Selecting CWS is 
possible. 

Actually, in these experiments only the modes IX and IV (with- 
out using CWS) were flown by the pilots, Permitting the pilot 
to monitor flight director and autopilot status, there is an 
autopilot annunciator panel located on the right side of the 
flight director indicator. Also, 3 trim indicators (rudder, 
aileron, elevator) provide visual indication of autopilot 
force applied to the respective control surfaces. 

The HPB-320 simulator includes a full set of conventional 
flight and engine instruments as well as marker lamps , annun- 
ciator warning panel, radio call plate, and audio selector 
panel [MBB-UHPB, 1970] . The conventional flight instruments 
are: 


a) Turn and Bank Indicator 

b) Airspeed Indicator 

c) Radio Magnetic Indicator (not used) 

d) Radio Altimeter . 

e) Barometric Altimeter 

f) Vertical Speed Indicator 
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The following engine instruments are installed (one sot for 
each engine) ; 


a) Engine speed (RPM) 

b) Engine pressure ratio (EPR) 

c) Exhaust gas temperature (EGT) 

d) Oil temperature 
o) Oil pressure 

f) Fuel flow 

The landing gear control system located on the instrument 
panel incorporates a control switch for normal gear extension 
or retraction and an indicator to monitor the position and 
condition of the nose and main landing gear. 

A flap position indicator is placed above the landing gear 
position indicator. The flaps are operated from the flap 
control lever in the pedestal. Flap lever detents provide 0®, 
20®, 30®, and 50° flap positions. Elevator trim wheel, aileron 
and rudder trim switches plus trim position indicator, speed 
brake switch, outside air temperature, and the throttles arc 
housed in the pedestal of the cockpit. 

The pilot's control wheel is fitted with an autopilot dis- 
engage button, elevator electrical trim switch, go-around 
mode switch, CWS mode switches for roll- and pitch-axis (not 
activated in this study) , and an ATS (Automatic Throttle 
System) mode switch. Selecting ATS maintains the indicated 
airspeed present at the time of engagement. This is done by 
increasing or decreasing engine speed via computer control. 

Most of the controls in the overhead panel, the overhead and 
bulkhead circuit breaker panel, and the shroud panel are 
missing. However, starting switches for the engines, cockpit 
lighting switches and ventilator switches are available. 
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The HFB-320 simulator is oquippod with a Control-Feel Sim- 
ulation System and a Sound simulation System. Generating 
the artificial control feel is done by using two torque 
motors in the pitch axis and one torque motor in the roll 
axis. All of the three torque motors are powered from their 
respective power amplifiers housing in an interface cabinet. 

The sound Simulator generates electronically synthesized 
aircraft sounds to provide realistic audible sounds that are 
normally heard at the flight dock of an aircraft. Aircraft 
sounds presented are [GSrtner and Hillmann, 1975] ; 

a) Engine N I - sound ^ (impeller and turbine whine/ 

b) Engine N® II- sound ' inlet ram air, and exhaust air) 

c) Aerodynamic airspeed-sound 

d) Landing gear extension - and retraction-sound 

e) Rolling wheels-sound 

An intercom audio selector panel at the pilot's side panel 
of the cockpit completes the equipment of the simulator flight 
deck. The intercom provides communication between the pilot 
and the experimenters. 

B. Flight Scenarios 

S*1 Scenarios for Experiment I 

The flight missions prepared for ,/ese studies should be 
divided into three different flight situations: 

a) Normal situation (N) 

b) Abnormal situation (A) 

c) Emergency situation (E) 

Initial conditions for every flight mission were always the 
same and are given in the following: (Aircraft position 
reference datum is the localizer transmitter.) 
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X“p0oition; 

y-pooifeion? 

Altitude : 

Indicated airspeed; 

Vertical speed; 

Heading 

Flap setting; 

Elevator trim 
wheel setting; 

Power sotting; 

Landing gear; 

Turbulence 

conditions; 

Automatic Throttle 
System; 

Flight Director 
Mode ; 


+ 24,000 m 
+ 9,500 m 

7,000 ft 
140 kts 
0 ft /min 
250 ° 

20 ° 

6 divisions nose up 
83 % RPM (both engines) 

UP (retracted) 

moderate vertical gusts (0.3 m/s) 
ON (engaged) 

HEADING HOLD, ALTITUDE HOLD 


The pilots wore told to use the ATS in all flight phases ex- 
cept Landing and Ground Roll. They were asked never to change 
the flap setting and never to use the speed brakes . 


B.1,1 The Normal scenario 

The normal situation (N scenario) is the basic flight scenario 
and was designed to have seven flight phases. Table 2 is a 
complete listing of the ATC instructions (Air Traffic Con- 
troller) for this normal scenario given by one of the experi- 
menters, A time schedule is included and the associated flight 
phases are labeled. 

Some instructions do not include the exact time of report. 

Due to the various rates of descent executed by the pilots, 
only an estimated time of report is possible. There is no 
occurrence of an abnormal or unexpected event causing the 
pilot to initiate an abnormal or emergency procedure. The 
flight director remains active during the total flight mission. 
However, the autopilot is disengaged and the pilot manually 
follows the command display. 
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Table 2: ATC instructions for N scenario 


TIME 
mill sec 

FLIGHT 

PHASE 

ATC INSTRUCTION 

PILOT'S 

RJESPONSE 

00 

: 00 

Cruise 

HFB Experiment inception. 

Affirmative. 

06 

: 15 

Cruise 

KFB is cleared for crosswiud 
leg, mahe a left turn HDG 160. 

Left turn 160 for 
crosswind. 

07 

; 15 

Descent 

HFB is cleared to 1,500 ft, 
report reaching 1,500. 

Cleared to 1,500, 
will report reaching. 

08 

: 15 


HFB, Cologne weather: QNH as 
given, wind calm, visibility 
10 +. 

Thanks for the 
weather. 

09 

: 15 

Descent 

HFB is cleared for downwind 
leg, make a left turn HDG 070. 

Left turn 070 for 
downwind. 

11 

: 30 

Descent 

(estimated time of report 
only) 

HFB reaching 1,500. 

15 

: 15 

Holding 

HFB enter holding pattern, 
make a right turn HDG 250. 

Right turn 250 for 
holding. 

17 

: 15 

Holding 

HFB make a right turn HDG 070. 

Right turn 070. 

19 

: 15 

Holding 

HFB make a right turn HDG 250. 

Right turn 250. 

21 

: 15 

Holding 

HFB make a right turn HDG 070. 

Right turn 070. 

23 

; 15 

Holding 

HFB make a right turn HDG 250. 

Right turn 250. 

25 

; 15 

Holding 

HFB make a right turn HDG 070. 

Right turn 070. 

26 

: 45 

Initial 

Approach 

HFB is cleared for base legj 
make a left turn HDG 310. 

Left turn 310 for 
base. 

27 

: 45 

Initial 

Approach 

HFB is cleared to ILS 25, 
report position OM. 

Cleared to ILS 25, 
will report OM. 

29 

: 45 

Final 

Approach 

(estimated time of report 
only) . 

HFB position OM. 




cleared to land, check gear, 
report touch down. 

Cleared to land, three 
greens, will report 
touch dovm. 



Landing 

- 

- 

31 

: 30 

Ground 

Roll 

(estimated time of report 
only) . 

HFB touch down. 
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B.1.2 Changes for the /Vbnormal Scenarios 

The major difference between the basic scenario and the 
A scenarios (abnormal scenario) is the occurrence of poor 
weather conditions given via ATC instructions. This causes 
the pilot to consider procedural changes including the possi- 
bility of an additional flight phase, i.e., "cruise to alter- 
nate" . 

In the A^ scenario, the pilot receives at 04:45 the infor- 
ma' that runway 25 is closed due to heavy snowfall. He is 
intcjimed that snow removal is in progress and advised to 
stand by for further information. At 06:15, the pilot is in- 
structed to enter a holding pattern before descending. After 
getting cleared for crosswind leg and leaving 7,000 ft for 
1,500 ft, he receives the information that the runway is clear 
and wet. This information forces the pilot to cancel the 
possibility of a "cruise to alternate" and to continue his 
approach. A complete listing of the ATC instructions for the 
A^ scenario is given in Table 3. 

The ATC instructions for the scenario given in Table 4 
include a warning message at 08:15 concerned with an anti- 
cipated snowfall, followed by detailed weather information 
and the resulting instructions for procedural changes. 

Both of the abnormal scenarios A^ and A^ were exclusively 
flown with an active flight director during the total flight 
and the autopilot engaged until decision height. 

B.1,3 Changes for the Emergency Scenarios 

The emergency flight scenarios were characterized by an un- 
expected loss of engine N° II thrust. This is done by acti- 
vating an engine shut-down switch located at the experimenters ' 
desk. The engine N° II shut-down is initiated at 14:45 in 
case of scenario. Because of the single engine • failure, the 
holdings were completely cancelled and the pilot is cleared 
to continue his approach immediately. Cancellation of the 
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Table 3 ; ATC instructions for A^ scenario 


TIME 
min sec 

FLIGHT 

PHASE 

ATC INSTRUCTION 

PILOT'S 

RESPONSE 

00 ; 

00 

Cruise 

HFB Experiment inception. 

Affirmative. 

04 : 

45 

Cruise 

HFB, Cologne weather is tem- 
porarily below minima, runway 
25 is closed due to heavy snow- 
fall, snow removal in progress 
for to minutes, standby for 
further information. 

Affirmative, request 
holding pattern. 

06 ! 

15 

Holding 

HFB enter holding pattern, make 
a left turn HDG 070. 

Left turn 070 for 
holding. 

08 ; 

15 

Holding 

HFB make a left turn HDG 250. 

Left turn 250. 

10 ; 

15 

Holding 

HFB make a left turn HDG 070. 

Left turn 070. 

12 s 

15 

Holding 

HFB make a left turn HDG 250. 

Left turn 250. 

14 : 

15 

Holding 

HFB make a left turn HDG 070. 

Left turn 070. 

16 : 

15 

Holding 

HFB make a left turn HDG 250. 

Left turn 250. 

18 ; 

15 


HFB is cleared for crosswind 
leg, make a left turn HDG 160. 

Left turn 160 for 
crosswind. 

19 : 

15 

Descent 

HFB is cleared to 1,500, report 
reaching 1,500. Runway 25 is 
clear and wet. Cologne weather; 
QNH as given, wind calm, visi- 
bility 10 +. 

Cleared to 1,500, will 
report reaching. 

Thanks for the weather 

21 : 

45 

Descent 

HFB is cleared for downwind 
leg, make a left turn HDG 070. 

Left turn 070 for 
downwind. 

23 : 

30 

Descent 

(estimated time of report only) . 

HFB reaching 1,500. 

26 ; 

45 

Initial 

Approach 

HFB is cleared for base leg, 
make a left turn HDG 310. 

Left turn 310 for 
base. 

27 : 

45 

Initial 

Approach 

HFB is cleared to ILS 25, 
report position OM. 

Cleared to ILS 25, 
will report OM. 

29 ; 

45 

. Final 
Approach 

(estimated time of report only) . 

HFB position OM. 




Cleared to land, check gear, 
report touch down. 

Cleared to land, three 
greens, will report 
touch down. 



Landing 

- 

- 

31 : 

30 

Ground 

(estimated time of report only) . 

HFB touch down. 


Roll 
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Table 4! ATC Instructions for Aj scenario 


TIME 
min sec 

FLIGHT 

PHASE 

ATC INSTRUCTION 

PILOT'S 

RESPONSE 

O 

o 

00 

Cruise 

HFB Experiment inception. 

Affirmative. 

06 *. 

15 

Cruise 

HFB is cleared for crosswind 
leg, make a left turn HDG 160. 

Left turn 160 for 
crosswind. 

07 ; 

15 

Descent 

HFB is cleared to 1,500 ft, 
report reaching 1,500. 

Cleared to 1,500, 
will report reaching. 

00 

o 

15 

Descent 

HFB, we expect snowfall, stand 
by for further information. 

Affirmative. 

o 

VD 

45 

Descent 

HFB is cleared for downwind 
leg, make a left turn HDG 070. 

Left turn 070 for 
downwind . 

11 : 

30 

Descent 

(estimated time of report only) . 

HFB reaching 1,500. 

13 : 

45 


HFB, Cologne weather is fairly 
CAT I, runway 25 is closed due 
to heavy snowfall, snow removal 
in progress for 10 minutes, 
standby for further information. 

Affirmative, request 
holding pattern. 

13 : 

15 

Holding 

HFB enter holding pattern, make 
a right turn HDG 250. 

Right turn 230 for 
holding. 

17 : 

15 

Holding 

HFB make a right turn HDG 070. 
We expect runway to be clear 
in 10 minutes. 

Affirmative, right 
turn 070. 

19 : 

15 

Holding 

HFB make a right turn HDG 250a 

Right turn 250. 

21 : 

15 

Holding 

HFB make a right turn HDG 070. 

Right turn 070. 

23 ; 

15 

Holding 

HFB make a right turn HDG 250. 

Right turn 250. 

25 : 

15 

Holding 

HFB make a right turn HDG 070, 
runway 25 is clear and wet, 
Cologne weather: QNH as given, 
wind calm, visibility 10 +. 

Affirmative, right 
turn 070, thanks for 
the weather. 

26 : 

45 

Initial 

Approach 

HFB is cleared for base leg, 
make a left turn HDG 310. 

Left turn 310 for 
base. 

27 : 

45 

Initial 

Approach 

HFB is cleared to ILS 25, report 
position OM. 

Cleared to ILS 25, 
will report OM. 

29 ; 

45 

Final 

Approach 

(estimated time of report only). 

HFB position OM. 




Cleared to land, check gear, 
report touch down. 

Cleared to land, three 
greens, will report 
touch down. 



Landing 

- 


31 : 

30 

Ground 

(estimated time of report only) . 

HFB touch down. 


Roll 
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holdings reduces the time duration of the scenario to 
about 20 minutes. 

At the E 2 scenario, the engine failure was initiated shortly 
after the pilot had reported his outer marker position, i.e., 
approximately at 30:00. Disregarding the engine failure, the 
E 2 scenario is identical to the N scenario. The pilot was 
instructed to continue his approach as possible and to report 
touch down. Manual flight control with an operating flight 
director was used to execute the emergency flight scenarios. 
After detecting the engine failure, the pilots were not ex- 
pected to execute the complete engine shut-down procedure 
specified by the aircraft manufacturer. Instead, they were 
told to compensate the loss of thrust by using the respective 
trim switches for rudder and aileron. To improve thrust con- 
trol of the operative engine, they were allowed to disengage 
the automatic throttle system if desired. 

* 

The time schedules for the emergency scenarios E^ and E 2 
correspond to that of the N scenario with the exception of 
the engine failures as described in this section (see Table 2) 

B. 2 Scenarios for Experiment II 

The flight missions used in the Experiment II include several 
modifications for the normal, abnormal, and emergency sce- 
narios. The major difference is the absence of the flight 
phase "Holding” in any type of flight mission. In the fol- 
lowing, all the changes will be explained in detail. Time 
schedules and ATC instructions for normal, emergency, and 
multi-event scenarios are added. The initicil conditions are 
identical to the ones used in the first experiment. All the 
various types of scenarios were flown with both the manual 
and the autopilot mode. 
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Tabxe 5: ATC instructions for N scenario (Experiment II) 
TIME FLIGHT PILOT'S 


min sec 

PHASE 

ATC INSTRUCTION 

RESPONSE 

00 ; 00 

Cruise 

HFB Experiment inception. 

Affirmative. 

06 : 10 

Cruise 

HFB is cleared for crosswind 
leg, make a left turn HDG 160. 

Left turn 160 
for crosswind. 

07 ; 10 

Descent 

HFB is cleared to 1,500 ft, 
report reaching 1,500. 

Cleared to 1,500, 
will report reaching. 

08 : 10 


HFB, Cologne weather: QNH as 
given, wind calm, visibility 
10 +. 

Thanks for the 
weather. 

09 : 50 

Descent 

HFB is cleared for downwind 
leg, make a left turn HDG 070. 

Left turn 070 
for downwind. 

12 ! 00 

Descent 

(estimated time of report only). 

HFB reaching 1,500. 

15 : 10 

Initial 

Approach 

HFB is cleared for base leg, 
make a left turn HDG 310. 

Left turn 310 
for base. 

15 : 30 

Initial 

Approach 

HFB is cleared to ILS 25, 
report position OM. 

Cleared to ILS 25, 
will report OM. 

18 : 00 

Final 

Approach 

(estimated time of report only). 

HFB position OM. 



Cleared to land, check gear, 
report touch down. 

Cleared to land, 
three greens, will 
report touch down. 


Landing 

- 

- 

20 : 30 

Ground 

Roll 

(estimated time of report only) . 

HFB touch down. 


B . 2 . 1 The Normal Scenario 

This basic flight scenario is again the so-called N scenario. 
The time schedule with the complete ATC instructions is given 
in Table 5 . 

B.2.2 Changes for the Abnormal Scenarios 

Comparing the A^ and A 2 scenarios of Experiment II with Ex- 
periment I, there are only slight differences (see also 
Table 4) . Closing the runway due to heavy snowfall is an- 
nounced at 04:10 for the A^ scenario. Thus, the possibility 
of requiring the pilot to enter a holding pattern or to cruise 
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to the alternate airport is presented. The ATC information 
given at 14;30 opens the runway. This enables the pilot to 
neglect a holding procedure as well as cruising to the alter- 
nate. 

The A 2 scenario involves weather conditions temporarily 
below minima due to dense fog announced at 07:30. This forces 
the pilot to consider the same possiblities as in the A^ sce- 
nario, An ATC instruction, also announced at 14:30, gives the 
pilot good visibility to initiate a standard approach. 

B.2.3 Changes for the Emergency Scenarios 

The first emergency situation scenario) is a failure of 
the N° II engine at 04:10 into the flight. To improve the 
recognition of the emergency situation for the pilot, all the 
audible and visible alarm signals similar to those that were 
used in the real HPB-320 aircraft are supplied to the cock- 
pit. When the pilot had stated his engine failure, the flight 
was cleared to continue the approach as possible. The time 
schedule of the scenario is similar to that of the N sce- 
nario (see Table 5) . A different type of emergency situation 
is involved in the E 2 scenario by simulating total loss of 
hydraulic fluid. The failure is indicated via alarm bell and 
the flash of the associated warning lamps in the warning panel. 
Initiating the hydraulic system failure at 07:30 results in 
making gear lever, emergency gear lever, and emergency hand 
pump inoperative. Table 6 shows the complete ATC instructions 
for the E 2 scenario. 

The last trial each pilot had to perform in the Experiment II 
was the ME scenario (Multi-Event) . This is a combination of 
the principal items of the A^ scenario, E^ scenario, and the 
E 2 scenario. Of course, the ME scenario was the most strenuous 
flight mission to the pilot. To increase the comprehension of 
what really happened during this flight, a complete listing 
of the instructions is given in Table 7 . 



56 


Table 6: ATC instructions for E 2 scenario (Experiment II) 


TIME 
min sec 

FLIGHT 

PHASE 

ATC INSTRUCTION 

PILOT'S 

RESPONSE 

00 ; 

00 

Cruise 

HFB Experiment inception. 

Affirmative. 

06 : 

10 

Cruise 

HFB is cleared for crosswind 
leg, make a left turn HDG 160, 

Left turn 160 
for crosswind. 

07 ; 

10 

Descent 

HFB is cleared to 1,500 ft, 
report reaching 1,500, 

Cleared to 1,500, 
will report reaching. 

07 : 

30 


INITIATION OF HYDRAULIC 
SYSTEM FAILURE. 


07 : 

50 


(estimated time of report 
only) . 

Distress signal 
(reason, request of 
foamy runway etc,). 




HFB affirmative, standby 
for information. 


08 : 

10 


HFB, Cologne weather; QNH 
a'j given, wi.nd calm, visi- 
bility 16 +. 

Thanks for the 
weather. 

9 : 

50 

Descent 

HFB is cleared for downwind 
leg, make a left turn HDG 070. 

Left turn 070 
for downwind. 

12 ; 

00 

Descent 

(estimated time of report 
only) . 

HFB reaching 1,500. 

15 : 

10 

Initial 

Approach 

HFB is cleared for base leg, 
make a left turn HDG 310. 

Left turn 310 
for base. 

15 : 

30 

Initial 

Approach 

HFB is cleared to ILS 25, 
report position OM. 

Cleared to ILS 25, 
will report OM. 

18 : 

00 

Final 

Approach 

(estimated time of report 
only) . 

HFB position OM. 




Runway foaming finished (if 
foaming was requested) , 
cleared for emergency landing. 

Affirmative, cleared 
for emergency landing 


Landing 


57 


Table 7 : ATC instructions for ME scenario 


TIME 
min sec 

FLIGHT 

PHASE 

ATC INSTRUCTION 

PILOT'S 

RESPONSE 

00 j 

00 

Cruise 

HFB Experiment inception. 

Affirmative. 

04 : 

10 


INITIATION OF ENG N° II- 
FAILURE. 


04 ; 

20 


(estimated time of report 
only) . 

Distress signal. 

05 : 

10 

Cruise 

HFB, Cologne weather is 
temporarily below minima, 
runway 25 is closed due to 
heavy snowfall, snow removal 
in progress for 10 minutes, 
standby for further infor- 
mation. 

Affirmative. 

06 ! 

10 

Cruise 

HFB is cleared for crosswind 
leg, make a left turn HDG 160. 

Left turn 160 
for crosswind. 

07 ! 

10 

Descent 

HFB is cleared to 1,500 ft, 
report reaching 1,500. 

Cleared to 1,500, 
will report reaching. 

07 ; 

30 


INITIATION OF HYDRAULIC 
SYSTEM FAILURE. 


07 : 

50 


(estimated time of report 
only) . 

Distress signal 
(reason, clearance 
request, etc.). 




HFB affirmative, standby 
for information. 


09 ; 

50 

Descent 

HFB is cleared for downwind 
leg, make a left turn HDG 070. 

Left turn 070 
for downwind. 

12 : 

00 

Descent 

(estimated time of report 
only) . 

HFB reaching 1,500. 

14 : 

30 


HFB, Cologne weather: QNH as 
given, wind calm, visibility 
10 +, runway 25 is clear and 
wet. 

Thanks for the 
weather. 

15 ; 

10 

Initial 

Approach 

HFB is cleared for base leg, 
make a left turn HDG 310. 

Left turn 310 
for base. 

15 : 

30 

Initial 

Approach 

HFB is cleared to ILS 25, 
report position OM, 

Cleared to ILS 25, 
will report OM. 

18 ; 

00 

Final 

Approach 

(estimated time of report 
only) . 

HFB position OM. 




Runway foaming finished (if 
foaming was requested) , 

Affirmative, cleared 
for emergency landing 


cleared for emergency landing. 


Landing 
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During the experimental flights, the pilot was sitting in- 
side the mockup of the HPB-320 simulator which has been 
described in Appendix A. Two experimenters were necessary 
to run the experiments. They were sitting outside the mock- 
up and communicated with the pilot via an intercom audio 
set. As shown in Figure 3, experimenter 1 was responsible 
for the ATC instructions and navigational information as 
explained in Appendix B whereas experimenter 2 gave the 
queries for depth of planning. A large clock served as a 
timer and was observed by the experimenters for a precise 
time-shared cooperation. The highest priority was devoted 
to asking the queries with equal time distances (see also 



Figure 3 : Experimental block diagram 
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Section 2.4.1), The ATC instructions were fitted into the 
intervals between the queries. However, urgent requests 
by the pilot were answered immediately. 

The order of the flight phases and subtasks for depth of 
planning were presented to experimenter 2 by a question- 
naire computer and shown on a display terminal (see Figure 3) . 
The answers of the pilot were entered via this terminal into 
the computer by experimenter 2. Queries and answers were 
stored on disk and printed as a protocol. 

The simulation computer was used for the HPB-320 flight sim- 
ulation and for the acquisition of performance data (see 
Figure 3) . The time functions which were sampled every 200 ms 
and stored on tape are shown in Table 8. Also, the performance 
tolerances mentioned in Section 2.4,4 are i»^cluded in Table 8. 
In addition, binary information on discrete events of the 
simulated flights was collected within one special word of 
the computer; this was also updated every 200 ms (see Table 9) . 

Experimenter 1 was additionally responsible for initiating 
the failures during the emergency scenarios (see Figure 3). 

The flight situation map drawn by an x-y-plotter outside the 
mockup was used by the experimenters for monitoring the flights 
online and as a quick-look protocol. 

All experiments lasted one day for each subject. First, the 
subjects became familiarized with the special features of the 
flight simulator by briefing and practicing as well as with 
the instructions for the experiment. The instructions were 
written in the pilot's native language, i.e., German. Also, 
the pilots answered a questionnaire concerning their flight 
experience. Further, the subjects responded to subjective 
scales for criticality, thereby getting acquainted with the 
flight phases and their subtasks and answering the question 
how critical these are to overall mission success. Then, the 
tests (T^ through Tg in Experiment I and T^ through in 
Experiment II) were performed. 
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Table 8; Time functions and performance tolerances 
measured during simulated flights 


Variable 


Explanation 


WEG X 

WEG Y 

TETAG 

FIG 

H 

V 

PSIG 

R 

HP 

DEVGS 

DEVIOC 

ITAKT 

COCKPI 

ENGOFF 

XI 

ETA 


x-coordinate in map 
y-coordinate in map 
pitch angle 
roll angle 
altitude 

indicated airspeed 
heading 
turn rate 
vertical speed 

vertical deviation from landing path 

horizontal deviation from landing path 

computer-cycle (40 ms) 

special word (see Table 9) 

engine no. II status (operating or failing) 

deflection of aileron control surface 

deflection of elevator control surface 


ZETA 

TETAG 

FIG 

X 

Y 

HPALT 

DEVGS 

DEVLOC 


deflection of rudder control surface 
pitch angle 
roll angle 

longitudinal position [" 
lateral position 
sink rate 

glideslope deviation | at 

localizer deviation J H®200 ftj 


•-4 

} 


at 

H-0 


performance 

tolerances 
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After each test, the pilots estimated their experienced 
workload for each of the flight phases using the appropri- 
ate subjective scales. The whole experimental session ended 
for each pilot with a final interview in which he was asked 
to express his experiences with the experiment and to comment 
on some elements of his behavior observed by the experimen- 
ters . 

All the instructions, off-line questionnaires, and subjective 
scales used in the experiments are included in Appendix E. 


Table 9: Binary signals measured during simulated flights 
(stored in one special word; COCKPI) 


Variable 


Explanation 


AP ENG 
VS HLD 
PD OFF 
LOG OPT 

^TR+ 

^TR- 


nutopilot engaged 

flight director mode; maintains vertical speed 
flight director turn-off-signal 

flight director mode; localizer beam capture + track 
movement of rudder trim tab; right deflection 
movement of rudder trim tab; left deflection 


?XR+ 

?TR- 
ALT HLD 
ATS ON 
STRT RGHT 
STRT LFT 
GEAR DN 
SPLR OUT 

'^KO 


movement of aileron trim tab; right deflection 

movement of aileron trim tab; left deflection 
flight director mode; maintains barometric altitude 
automatic throttle system engaged 
indicates starter function of starboard engine 
indicates starter function of port engine 
indicates extended gear position 
indicates extended spoiler position 

binary coded flap position; low bit 

binary coded flap position; high bit 
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D. Instructions and Final Interview in English *^ 


Experiment XI, January 1981 


INSTRUCTIONS 

for the execution of flight experiments 
in the HFB-320 simulator 


You have been so kind as to be willing to take part in our 
experiments in the simulator, 

We ask you to make several 20 minute flights including 
landing with different experimental conditions. Rest periods 
have been scheduled sufficiently. We are interested to know 
how you prepare as a pilot for a given flight course before 
and during a flight, how you think ahead or act spontan- 
eously, how much free play you can find for your own deci- 
sions, and how you work out solutions for unforeseen situa- 
tions. The results of these investigations should give us a 
first indication how pilots plan their flight guidance and 
control tasks. Such knowledge i,s an important basis for the 
design and the evaluation of future instrumentations (e.g., 
CDTI s Cockpit Displayed Traffic Information) and other com- 
puter-aided planning support. 

As far as we know, an investigation like this has not been 
executed at all until now. On the other hand, there seems 
generally to be great interest in our investigation as dis- 
cussions at Lufthansa and NASA showed. Therefore, we ask you 
to support us with your frank criticism as extensively as 
possible. Every hint due to your experience may help us. Be- 
tween the separate experimental flights, there will be an 


It should be noted that the actual written material em- 
ployed was in German (see Appendix E) . This translation 
is included for the benefit of non-German speaking readers. 
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opportunity for critique and discussion. All data and hints 
will be used only for scientific purposes and will not be 
pa-^sed on. There is no test situation in the whole experi- 
mental program. 

Circling flight 

Before starting the essential experiments, you shall first 
become acquainted with our flight simulator of the HFB-320. 
Now you could, e.g., start, make a circling flight, and land 
again - just as you like it. 


CIRCLING FLIGHT 


Questionnaire about flight experience 

We ask you, now, to give us some information concerning, e.g. , 
the number of your flight hours. 


FILL OUT QUESTIONNAIRE 


Flight course 

With the help of a map , Mr. Hillmann will explain the given 
flight course to you. The flight course has been divided into 
8 flight phases; 

Cruise, 

Descent, 

Holding , 

Initial Approach, 

Final Approach, 

Landing , 

Ground Roll, 

Cruise to Alternate. 

In the simulator you will find an approach-flight map. 
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During the experimental flights, Mr. Hillraann will give you 
the necessary instructions for the approach procedure. He 
assumes the role of the air traffic controller as well as 
the role of the co“pilot for you - however, both over the 
intercom audio set. 

Two different levels of automation will be chosen, namely 

manual, i.e., without autopilot always with 

Flight Director 

autopilot, i.e., with autopilot^ and Autothrottle 

Before each experimental test, you will be informed about the 
level of automation to be actually flown. The flap position 
20“ shall principally remain unchanged during all tests. 

During some tests, you have to expect unforeseen events. 
Please, understand that we cannot give further information 
thereon. Master the situation as you would do it in practice. 
You have complete decision freedom within the possibilities 
of our simulator and the instructions given to you. Also here- 
with, Mr. Hillmann is at your disposal as air traffic con- 
troller and co-pilot. 

Immediately after each test, we. want to know how you rate 
your subjectively experienced workload during the separate 
flight phases. Please, cross-mark the workload scales corre- 
spondingly. 

LOOK AT SCALES 


Questionnaire Technique 


We want to conceive in our investigation how pilots act, 
think ahead, and plan. In order to find this out from you, 
we have invented a questionnaire technique. 


The flight course has been divided into 8 flight phases. We 
shall ask you during all further tests over the intercom 
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audio set about a certain flight phase or an associated 
subtask in a random order with intervals of about 20 seconds. 
Then, you shall answer as quick as possible (as far as the 
flight situation allows) how intensively you have been think- 
ing about the respective flight phase or subtask. The queries 
will be interspersed by Mr. Johannsen between the flight guid- 
ance communication with Mr. Hillmann. Please, give your an- 
swers coded by numbers, as will be explained below. 

You shall familiarize yourself, now, with the flight phases 
and the selected subtasks by means of a table. We ask you to 
cross-mark on always one scale how important, in your opinion, 
each individual flight phase and subtask is relative to the 
accomplishment of the overall mission, i.e., the complete 
flight course. 


CROSS-MARK SCALES 


During the flight tests, there are 10 possible answers for 
you to the query 

"Are you thinking at the moment (or were you 
thinking during the last 20 seconds) about 
the flight phase or subtask just mentioned"? 

The answers are associated with the numbers 1 to 10, approxi- 
mate.” v the following scheme: 


66 


tn 

a 

•H 


§ 


r*l 

m 

0 

S 


0) 

P 


? 



To what extent are you planning with 
respect to the flight phase or subtask? 

1 

NOT AT ALL 

2 


3 

GENERALLY AWARE OP TASK 

4 


5 

OVERALL QUALITATIVE ASSESSMENT ONLY 

6 


7 


8 

SPECIFIC INFORMATION NEEDS 

9 


10 

CONSIDERING SPECIFIC ACTIONS 


In order to save time and to disturb you as little as pos^* 
sible during the accomplishment of your flight task, only 
the respective flight phase or subtask will be named with 
the queries and it will be dispensed with the repetition of 
the complete text of the queries. Due to the same reasons, 
please respond only with the numbers associated with the 
answers. Therefore, you should remember the table very care- 
fully. Thereby, please understand the table as a coarse scheme 
with the response possibilities 1 to 10. The associated text 
explanations are not to be taken literally but shall only 
illustrate how you penetrate from 1 to 1 0 deeper and deeper 
into the planning tasks. With your answers, please take care 
of using the whole scale from 1 to 10. 

After you have read these instructions completely, we will 
familiarize you in a short pre-test with the questionnaire 
technique. Thereby, we ask you to fly with the level of. auto- 
mation "Manual". 

We ask you to accept patiently the queries as necessary addi- 
tional communication. Give your answers as quick as possible. 
However, it has to be pointed out explicitly that flying is 
the more important task for you. If you must, therefore. 


re- 
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spend slower, because you just have much to do, then this 
is absolutely okay. Should you have once no time at all for 
an answer, say "No" or "Nein". We shall continue also in that 
case with our queries as intended. 

And now, enjoy the tests and many thanks for your partici- 
pation. 

Finally, a SOLICITATION to you: 

Pass on no information about our tests to other pilots. Your 
colleagues shall come to us with the same status of infor- 
mation which you had. You can easily imagine that pre-infor- 
mation would be troublesome. 

Many thanks. 


PRE-TEST 
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FINAIi INTERVIEW 


Pilot: 


Date: 


Time: 


1 . Did you feel disturbed by our additional queries during 
your flight task? 

2. Did you give your answers automatically or after some 
consideration (thinking) ? 

3. Did you give your answers as you would give them in daily 
flight operation or did you feel an artificial test situ- 
ation? 

4. Do your answers characterize more 


the actual or the mental 

execution anticipation 


of subtasks 
(actions) 


of flight phases 
(plans) 


% normal % 

% emergency % 


5. Did our queries comprehend the essential subtasks of the 
flight mission? 


6 . About what tasks or problems did you think very intensively 
during the flights without our asking about it? 

7. During which flights have you produced most of all planning 
effort? Give a rank order where 1 means most effort. 


normal 


automatic 

□ 

manual 

□ 

abnormal 


□ 

□ ' 

emergency 

engine failure 

□ 

□ 


^ hydraulic failure 

□ 

□ 
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8, Did your planning occur more automatically (by rote, R) 
or after some consideration (thinking, T) ? 

Enter the letter R or T: 




automatic 

manual 

normal 


□ 

□ 

abnormal 


□ 


emergency 

engine 

□ 



hydraulic 

□ 

□ 


9. Do you consider routine or conscious planning the more 
important? 

10. Were the flights at the beginning or at the end of the 
experimental sequence harder for you? 

11, How would you judge our experiments all together? 

■^2. Could you imagine practical possibilities of application? 

13. What has annoyed you particularly? 

14. Would you like to take part in further experiments? 


A. Did your attitude with respect to our investigation or 
your understanding of it change during the experiments , 
e.g., due to experience? Did you answer differently at 
the end of the experimental sequence as compared to the 
beginning? 

B. Have you seized the structure of our questionnaire scheme? 

C. Do there exist (in your opinion), no, little, medium or 
great individual differences between pilots concerning 
the planning behavior? 

Of what kind are these differences? 
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E. Instructions , Questionnaires , and Final Interview In 
German 


Experiment I, Dezember 1979/Januar 1980 


INSTRUKTIONEN 

zur DurchfUhrung von Flugversuchen Im HFB-320 Simulator 


Sie haben sich freundlicherweise bereit erklart, an unseren 
Versuchen im Simulator teilzunehmen. 

Wir bitten Sie, mehrere etwa halbstiindige Pliige einschlieSlich 
Landung mit unterschiedlichen Versuchsbedingungen durchzu- 
fiihren. Erholungspausen sind in ausreichendem Mafie vorgesehen. 
Uns interessiert / wie Sie sich als Pilot vor und wahrend 
eines Pluges auf einen vorgegebenen Plugverlauf einstellen, 
wie weit Sie vorausdenken oder spontan handeln, wieviel Spiel- 
raum Sie fiir eigene Entscheidungen finden konnen und wie Sie 
Losungen fiir unvorhergesehene Situationen erarbeiten. Die Er- 
gebnisse dieser Untersuchungen sollen uns einen ersten Anhalt 
geben, wie Piloten ihre Plugfiihrungsaufgaben planen. Der- 
artige Kenntnisse sind wichtige Voraussetzungen fiir den Ent- 
wurf und die Bewertung zukiinf tiger Instrumentierungen (z.B. 

CDTI = Cockj,iit Display Traffic Information) und andere rechner- 
gestiitzte Planungshilfen . 

Nach unserem Wissen ist eine Untersuchung wie die vorliegende 
noch nirgendwo durchgefiihrt worden. Andererseits scheint grund- 
satzlich ein groBes Interesse an unserem Vorhaben zu bestehen 
wie Gesprache bei der Lufthansa und der NASA zeigten. Aus 
diesen Griinden bitten wir Sie, uns mit Ihrer offenen Kritik 
moglichst weitgehend zu unterstiitzen. Jeder Hinweis aufgrund 
Ihrer Erfahrungen kann uns helfen. Zwischen den einzelnen Plug- 
versuchen wird Gelegenheit zur Kritik und zum Gesprdch sein. 
Alle Daten und Hihweise werden nur fiir wissenschaftliche Zwecke 
benutzt und nicht weitergegeben. Im gesamten Versuchsprogramm 
liegt keine Tests ituatlon vor. 


Platzrunde 


Vor den eigentlichen Versuchen sollen Sie sich zundchst mit 
unserem Plugsimulator der HPB-320 vertraut machen. Sie .kdnnen 
jetzt z.B. starten, eine Platzrunde fliegen und wieder landen 
ganz nach Ihrem Belieben. 


PLATZRUNDE 


Pragebogen iiber Plugerfahrung 

Wir bitten Sie jetzt, uns einige Informationen zur Anzahl 
Ihrer Plugstunden usw. zu geben. 

PRAGEBOGEN AUSPOLLEN 


Flugverlauf 

Der vorgegebene Flugverlauf wird Ihnen anhand einer Landkarte 
von Herrn Hillmann erlautert. Der Flugverlauf ist in die 7 
Plugphasen 

Cruise , 

Descent , 

Holding, 

Initial Approach, 

Final Approach, 

Landing , 

Ground Roll 

unterteilt worden. 

Herr Hillmann wird Ihnen wahrend der Flugversuche die not- 
wendigen Anweisungen fiir das Anflugverfahren geben. Er liber- 
nimmt fiir Sie sowohl die Rolle des Pluglotsen als auch die 
des Copiloten “ beides jedoch iiber die Wechselsprechanlage . 
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Ptir die Versuche werden zwei verschiedene Automatisierungs- 
stufen gewMhlt, naralich 

M Manuell, d.h. ohne Autopilot *1 rait 

A Autopilot, d.h. mit Autopilot J* Director 

Vor jedem Versuch wird Ihnen die jeweils zu fliegende Auto- 
matisierungsstufe mitgeteilt. 

Bei einigen Versuchen mUssen Sie mit unvorhergesehenen Er- 
eignissen rechnen. Bitte haben Sie VerstSndnis dafiir, daB 
wir Ihnen dariiber keine weiteren Informationen geben kbnnen. 
Meistern Sie die Situation so, wie Sie es auch in der Praxis 
tun wiirden. Sie haben im Rahmen der MSglichkeiten unseres 
Simulators und der Ihnen gegebenen Anweisungen vbllige Ent- 
scheidungsfreiheit . Herr Hillmann steht Ihnen auch hierbei 
als Fluglotse und Copilot zur Verfiigung. 

Unmittelbar nach jedem Versuch rabchten wir wissen, wie Sie 
Ihre subjektiv empfundene Beanspruchung wShrend der einzelnen 
Flugphasen einschStzen. Bitte kreuzen Sie entsprechend die 
Beanspruchungsskalen an. 

Im ersten Versuch bitten wir Sie nun, den vorgegebenen Plug- 
verlauf mit der Automatisierungsstufe M (Manuell) zu erfliegen. 


1 . VERSUCH 


Befragungsm.ethode 

Wir wollen in unserer Untersuchung erfassen, wie Piloten 
handeln, vorausdenken und planen. Urn dies von Ihnen zu er- 
fahren, haben wir uns eine Befragungsmethode ausgedacht. 

Der Plugverlauf ist in 7 Flugphasen unterteilt. Wir werden 
Sie bei nahezu alien weiteren Versuchen in Abstanden von 
etwa 30 Sekunden (gelegentlich seltener) iiber die Wechsel- 
sprechanlage in zufSlliger Reihenfolge nach einer bestimmten 
Plugphase fragen. Sie sollen uns dann mbglichst schnell (so- 
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weit es die Flugsituation erlaubt) antworten, wie intensiv 
Sie an die jeweilige Flugphase gedacht haben. Die Fragen 
werden von Herrn Johannsen zwischen die FlugfUhrungskommu- 
nikation mit Herrn Hillmann eingestreut. Ihre Antworten 
geben Sie bitte als Ziffern verschltlsselt , wie weiter unten 
erldutert wird. 

In einzelnen Fdllen werden Sie zus^tzlich nach maximal 3 
Teilaufgaben pro Flugphase befragt. Diese Fragen erfolgen 
immer gebUndelt unmittelbar eine nach der anderen. Zum Ab~ 
schluB eines derartigen Fragenkomplexes wird "What else?" 
gefragt. Sie erhalten damit Gelegenheit,. uns stichwortartig 
mitzuteilen, mit welchen Planungs- oder Denkaufgaben Sie 
wHhrend der letzten halben Minute sehr stark beschSftigt 
waren - nach denen wir Sie aber nicht direkt gefragt hatten. 
Wenn Sie keine derartige Mitteilung zu machen haben ^ ant- 
worten Sie z.B. "Nichts", "Nothing" oder Mhnliches. 

Sie sollen sich jetzt anhand einer Tabelle mit den Flug- 
phasen und Teilaufgaben vertraut machen. Wir bitten Sie, auf 
je einer Skala anzukreuzen, wie wichtig nach Ihrer Meinung 
jede einzelne Flugphase bzw. Teilaufgabe in bezug auf die 
Erftillung der Gesamtmission, d.h. den gesamten Flugverlauf, 
ist. 


SKALEN ANKREUZEN 


Es gibt fUr Sie wMhrend der Flugversuche 5 mSgliche Ant- 
worten auf die Frage 

"Denken Sie im Augenblick (oder dachten Sie wahrend 
der letz'hen halben Minute) an die jeweils ange- 
sprochene Flugphase bzw. Teilaufgabe?" 

Die Antworten sind den Ziffern 1 bis 5 nach folgendem Schema 
zugeordnet ; 
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Denken Sie an Flugphaso bzw. Tailaufgabo? 


Ubbrhaupt night 

NEHME GANZ ALLGEMEIN AUFGABE WAHR 
nur qualitative GESAMTEINSCHATZUNG 
BBSTIMMTE INFORMATIONSBEDURFNISSE 

ERWAGE bestimmte handlungen 


Urn Zeit zu sparon und Sie bei der Durchfilhrung Ihrer Plug- 
fiihrungsaufgabe so wenig wie mbglich zu stdren, wird bei 
den Pragen nur die jeweilige Plugphase bzw. Teilaufgabe 
genannt und auf die Wiederholung des vollstandigen Fragen- 
textes verzicbtet. Aus denselben GrUnden antworten Sie bitte 
nur mit der den Antworten zugeordnete Ziffer, Sie miiUten 
sich die Tabelle daher sehr genau einprAgen. Verstehen Sie 
dabei die Tabelle bitte als grobes Schema mit den Antwort- 
mdglichkeiten 2 , 3 , 4 Oder 5. Die zugeordneten Texter- 
lAuterungen sind nicht wdrtlich zu nehmen, sondern sdllen 
nur verdeutlicheai wie Sie von 1 bis 5 immer tiefer in die 
Planungsaufgaben eindringen. Achten Sie bitte bei Ihren 
Antworten darauf, dalJ die gesamte Skala von 1 bis 5 ver- 
wendet warden soli. 

Unmittelbar nach jeder Antwort Ihrerseits schlieflt sich 
eine Prage mit der Kurzform "Zunahme der Schwierigkeit?" an. 
Dahinter verbirgt sich folgende ausfiihrliche Frage; 

"Erwarten Sie, ausgehend von der gegenwMrtigen 
Situation und dem Flugzustand, eine Zunahme der 
Schwierigkeit bei der Durchfilhrung der zuletzt 
angesprochenen Aufgabe bzw. bei der Nutzung der 
angesprochenen Information iiber das NormalmaB 
der Schwierigkeit hinaus?" 

Wir meinen damit nicht , ob Sie mit der aktuellen Situation 
und dem Flugzustand zufrieden sind. Es interessiert nur 
eine raogliche Auswirkung der gegenwSrtigen Situation und 
des Plugzustands im Hinblick auf die zuvor angesprochene 

i*, 

Plugphase bzw. Teilaufgabe. 
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Auf die Prage nach der oKwarteton Zunahme der SchwiQrigkeit 
haben Sie ebcnfalls 5 mOgliche Antworten, Sie nennen bitte 
wieder nur die zugeordnete zit£er nach dera folgcnden Schemas 



Erwartote Zunahme der Schwierigkeit? 

1 

KEINE 

2 

GERINGER 

3 

MASSIG 

4 

BETRACHTLICH 

5 

SEHR BETRACHTLICH 


Wir bitten Sie, die Befragung als notwendige zusStzliche 
Kommunikation gelassen hinzunehmen. Geben Sie uns alle Ant- 
worten mdglichst schnell, Ausdrtlcklich sei jedoch darauf hin- 
gewiesen, daB das Fliegen ftir sie die wichtigere Aufgabe iat. 
Wenn Sie also langsamer antworten mUssen, weil Sie gerade 
viel zu tun haben, so ist das vQllig in Ordnung. Sollten Sie 
einmal gar keine Zeit fUr eine Antwort haben, sagen Sie ent- 
weder "No" Oder "Nein", Wir werden auch dann in beabsichtigter 
Weise mit unseren Pragen fortfahren. 

Nun viel SpaB bei den weiteren Versuchen und vielen Dank ftir 
das Mitmachen. 


VERSUCHE 


Zum SchluB eine BITTE an Sie; 

Geben Sie keine Informationen Uber unsere Versuche an andere 
Piloten welter. Ihre Kollegen sollen mit dem gleichen Infor- 
mationsstand, den Sie hatten, zu uns kommen. Sie kdnnen sich 
sicher leicht vorstellen, daB Vorinformationen stdren wlirden. 


Vielen Dank. 
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Exporiment II, Januar 1981 

INSTRUKTIONEN 

tW. lMU ll M l— WW— — W WW MI HHIIBJ 

2 ur DurchfUhrung von Fluqvorauchon Im HFB"320 Simulator 

Sie haben sich froundlichorweisG boreit erklUrt, an unscron 
Versuchen im Simulator tellzunohmen. 

Wir bitten Sie, mehrere etwa 20 Minuten dauornde Plttgc ein- 
schlieBlich Landung mit unterschiedlichon Varsuchsbedingungen 
durchzufUhren. Erholungspausen Bind in ausreichondem MaBe 
vorgesehen. Uns interessiert, wie Sie sich als Pilot vor 
und wUhrend eines Fluges auf einen vorgegebenen Plugverlauf 
einstellen, wie weit Sie vorausdenken Oder spontan handeln, 
wieviel Spielraum Sie fOr eigene Entscheidungen finden ktinnen 
und wie Sie L5sungen fiir unvorhergesshene Situationen erar- 
beiten. Die Ergebnisse dieser Untersuchungen sollen uns einen 
ersten Anhalt geben, wie Piloten ihre PlugfUhrungsaufgaben 
planen. Derartige Kenntnisse sind wichtige Voraussetzungen 
ftir den Entwurf und die Bewertung zukUnftiger Instrumentie- 
rungen (z.B. CDTI = Cockpit Displayed Traffic Information) 
und anderer rechnergesttitzter Plariungshilfen. 

Nach unserem Wissen ist eine Untersuchung wie die vorliegende 
noch nirgendwo durchgeftihrt worden. Andererseits scheint 
grundsatzlich ein grofles Interesse an unserem Vorhaben zu 
bestehen wie GesprSche bei der Lufthansa und der NASA zeigten. 
Aus diesen Grtinden bitten wir Sie, uns mit Ihrer offenen 
Kritik moglichst weitgehend zu unterstUtzen. Jeder Hinweis 
aufgrund Ihrer Erfahrungen kann uns helfen. '"■wischen den 
einzelnen Plugversuchen wird Gelegenheit zur Kritik und zum 
GesprSch sein. Alle Daten und Hinweise werden nur f(ir wissen*- 
schaftliche Zwecke benutzt und nicht weitergegeben , Im ge- 
samten Versuchsprograram liegt keine Testsituation vor. 
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P'xatzrunde 

Vor den eigentlichen Versuchen sollen Sie sich zunSchst mit 
unserem Plugsimulator der HPB-320 vertraut machen. Sie k5nnen 
jetzt z.B. starten, eine Platzrunde fliegen und wieder landen -- 
ganz nach Ihrem Belieben. 


PLATZRUNDE 


Pragebogen Uber Plugerf ahrung 

Wir bitten Sie jetzt, uns einige Informationen zur Anzahl 
Ihrer Plugsitunden usw. zu geben. 

PRAGEBOGEN AUSPULLEN 


Plugverlauf 

Der vorgegebene Plugverlauf wird Ihnen anhand einer Landkarte 
von Herrn Hillmann erlautert. Der Plugverlauf ist in die 8 
Plugj^hasen 

Cruise, 

Descent , 

Holding, 

Initial Approach, 

Pinal Approach, 

Landilsg, 

Ground Roll, 

Cruise to Alternate 

unterteilt worden. 

Eine Anflugkarte liegt fiir Sie im Simulator bereit. 

Herr Hillmann wird Ihnen wahrend der Plugversuche die not- 
wendigen Anweisungen fiir das Anf lugverfahren geben. Er iiber- 
nimmt fiir Sie sowohl die Rolle des Pluglotsen als auch die 
des Copiloten - beides jedoch iiber die Wechselsprechanlage. 
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FUr die Versuche werden zwei verschiedene Automatisierungs- 
stufen gewShlt, namlich 

Manuell, d.h. ohne Autopilot ' immer mit 

Flight Director 

Autopilot, d.h. mit Autopilot_ und Autothrottle 

Vor jedem Versuch wird Ihnen die jeweils zu fliegende Auto- 
matisierungsstufe mitgeteilt. Die Klappenstellung 20° soil 
in alien Versuchen grundsatzlich unverandert bleiben. 

Bei einigen Versuchen rniissen Sie mit unvorhergesehenen Er- 
eignissen rechnen. Bitte haben Sie Verstandnis dafUr, daS 
wir Ihnen dariiber keine weiteren Informationen geben konnen. 
Meistern Sie die Situation so, wie Sie es auch in der Praxis 
tun wUrden. Sie haben im Rahmen der Moglichkeiten unseres 
Simulators und der Ihnen gegebenen An^eisungen vollige Ent- 
scheidungsfreiheit . Herr Hillmann steht Ihnen auch hierbei 
als Pluglotse und Copilot zur Verfiigung. 

Unmittelbar nach jedem Versuch mochten wir wissen, wie Sie 
Ihre subjektiv empfundene Beanspruchung wahreno. der einzelnen 
Flugphasen einschatzen. Bitte kreuzen Sie entsprechend die 
Beanspruchungsskalen an. 


SKALEN ANSCHAUEN 


Befragungsmethode 

Wir wollen in unserer Untersuchung erfassen, wie Piloten 
handeln, vorausdenken und planen. Dm dies von Ihnen zu erfahren, 
haben wir uns eine Befragungsmethode ausgedacht. 

Der Flugverlauf ist in 8 Flugphasen unterteilt. Wir werden 
Sie bei alien weiteren Versuchen in Abstanden von etwa 20 
Sekunden iiber die Wechselsprechanlage in zufalliger Reihen- 
folge nach einer bestimmten Flugphase Oder einer zugehorigen 
Teilaufgabe fragen. Sie sollen uns dann moglichst schnell 
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(soweit es die Flugsituation erlaubt) antworten, wie in- 
tensiv Sie an die jeweilige Plugphase bzw. Teilaufgabe ge- 
dacht haben. Die Fragen werden von Herrn Johannsen zwischen 
die FlugfUhrungskommunikation mit Herrn Hillmann eingestreut. 
Ihre Antworten geben Sie bitte als Ziffern verschlUsselt , wie 
waiter unten erlSutert wird. 

Sie sollen sich jetzt anhand einer Tabelle mit den Flug- 
phasen und den ausgewShlten Teilaufgaben vertraut machen, Wir 
bitten Sie, auf je einer Skala anzukreuzen, wie wichtig nach 
Ihrer Meinung jed<i einzelne Flugphase bzw. Teilaufgabe in 
bezug auf die Erfiillung der Gesamtmission, d.h. den gesamten 
Flugverlauf, ist. 


SKALEN ANKREUZEN 


Es gibt fiir Sie w^hrend der Flugversuche 10 mogliche Ant- 
worten auf die Frage 


"Denken Sie im Augenblick (oder dachten Sie 
wahrend der letzten 20 Sekunden) an die je- 
weils angesprochene Flugphase bzw. Teilaufgabe?" 


Die Antworten sind den Ziffern 1 bis 10 nach folgendem Schema 
nSherungsweise zugeordnet; 


o 

o 

■p 

w 


nJ 

iH 


f 



Denken Sie an Flugphase bzw. Teilaufgabe? 

1 

tlBERHAUPT NIGHT 

2 


3 

NEHME GANZ ALLGEMEIN AUFGABE WAHR 

4 


5 

NUR QUALITATIVE GESAMTEINSCHATZUNG 

6 


7 


8 

Q 

BESTIMMTE INFORMATIONSBEDORFNISSE 

10 

ERWAGE BESTIMMTE HANDLUNGEN 
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Um Zeit i5u sparen und Sie bei der DurchfUhrung Ihrer Plug- 
ftihrungsaufgabe so wenig wie mSglich zu stdren, wird bei 
den Pragen nur die jeweilige Plugphase bzw. Teilaufgabe 
genannt und auf die Wiederholung des vollstMndigen Pragen- 
textes verzichtet. Aus denselben Griinden antworten Sie bitte 
nur mit der den Antworten zugeordneten Ziffer. Sie mUBten 
sich die Tabelle daher sehr genau einprSgen. Verstehen Sie 
dabei die Tabelle bitte als grobes Schema mit den Antwort- 
moglichkeiten 1 bis 10. Die zugeordneten Texterlauterungen 
Sind nicht w5rtlich zu nehmen, sondern sollen nur verdeut- 
lichen, wie Sie von 1 bis 10 immer tiefer in die Planungs- 
aufgaben eindringen. Achten Sie bitte bei Ihren Antworten 
darauf, daB die gesamte Skala von 1 bis 10 verwendet warden 
soil. 

Nachdem Sie diese Instruktionen vollstandig gelesen haben, 
werden wir Sie in einem kurzen Vorversuch mit der Befragungs- 
methode vertraut machen. Dabei bitten wir Sie, mit der Auto- 
matisierungsstufe Manuell zu fliegen. 

Wir bitten Sie, die Befragung als notwendige zusatzliche 
Kommunikation gelassen hinzunehmen. Geben Sie uns alle Ant- 
worten moglichst schnell. Ausdriicklich sei jedoch darauf 
hingewiesen, daB das Fliegen fiir Sie die wichtigere Aufgabe 
ist. Wenn Sie also langsamer antworten miissen, well Sie 
gerade viel zu tun haben, so ist das vollig in Ordnung. 
Sollten Sie einmal gar keine Zeit fiir eine Antwort haben, 
sagen Sie entweder ’No" Oder "Nein" . Wir werden aucL dann 
in beabsif.ihtigter Weise mit unseren Pragen fortfahren. 

Nun viel SpaB bei den Versuchen und vielen Dank fur das Mit- 

iiChluB eine BITTE an Sie: Geben Sie keine Informationen 
ill* r unsere Versuche an andere Piloten weiter. Ihre Kollegen 
sollen mit dem gleichen Informationsstand, den Sie hatten, zu 
uns kommen. Sie konnen. sich sicher leicht vorstellen, daB 
Vorinformationen storen wiirden. Vielen Dank. 


VORVERSUCH 
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Fragebogen tiber Flugerfahrung 

Name: 

Alter: 

Welche Fluglizenzen haben Sie? 

Anzahl der Flugstunden insgesamt? 

Anzahl der Flugstunden auf der HFB-320? 

Anzahl der Flugstunden auf anderen Flugzeugtypen? 
Typ Anzahl 


Sind Sie uberdurchschnittlich viel auf Simulatoren geflogen? 
Wenn ja, auf welchen? 


Bemerkungen Ihrerseits : 


Danke . 
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Pilots 

Bitte ankreuzen; 


v<311ig sehr 

unwichtig wichtig 

1 . Cruise 

1 . 1 Approach procedure 

1.2 Request to leave 

flight level 

1.3 Fuel control (+ Power 

setting) 

2. Descent 

2.1 Obstacle clearance 

. 2.2 Flight instruments 

2.3 Altimeter 

3. Holding 

— -I- ^ - . — 3.1 Track intercept 

3.2 Traffic orders 
(+ information) 

3.3 ATIS (e.g., runway con- 

dition, weather, QNH) 

4. Initial Approach 

4.1 Flaps 

‘ 4.2 Localizer intercept 

4.3 Glideslope intercept 

5. Final Approach 


Wie wichtig (im Sinne 
von besser aufpassen) ist 
jede der folgendeti Flug- 
phasen bzw. Teilaufgaben 
in bezug auf die ErfUllung 
der Gesamtmission? 


5.1 

5.2 

5.3 


Gear 

Weather minima 
Flare 
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vBllig sehr 

unwichtig wichtig 


6. Landing (Flare + 
Touchdown) 

6.1 Crosswind 

6.2 Runway condition 

6.3 Passenger comfort 


7. Ground Roll (after 
Landing) 

7.1 On centerline 

7.2 Speed-brakes 

7.3 Flaps 


8. Cruise to alternate 

8.1 Approach procedure 

8.2 Request to leave 
flight level 

8.3 Fuel control (+ Power 
setting) 


i 
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Beanspruchunqsskalen 


Pilot; VNr.; Datum; Uhrzeit; 

Wie stark ftihlten Sie sich durch die Arbeitsbelastung subjektiv 
beansprucht? Geben Sie die Antworten bitte getrennt fUr die 7 
Flugphasen durch Ankreuzen der folgenden Skalen. 


Cruise 


Descent 


Holding 


Initial Approach 


Final Approach 

J 

) 


Landing 


Ground Roll 


sehr geringe 
Beanspr, 

geringe 

Beanspr. 

eher geringe 
Beanspr, 

mittlere 

Beanspr, 

eher hohe 
Beanspr. 

hohe 

Beanspr. 

sehr hohe 
Beanspr 

sehr geringe 
Beanspr. 

geringe 

Beanspr. 

eher geringe 
Beanspr. 

mittlere 

Beanspr, 

eher hohe 
Beanspr. 

hohe 

Beanspr, 

sehr hohe 
Beanspr. 

sehr geringe 
Beansipr. 

geringe 

Beanspr. 

eher geringe 
Beanspr. 

mittlere 

Beanspr, 

eher hohe 
Beanspr. 

hohe 

Beanspr. 

sehr hohe 
Beanspr. 

sehr geringe 
Beanspr. 

• > ♦ 

geringe 

Beanspr. 

eher geringe 
Beanspr, 

mittlere 

Beanspr. 

eher hohe 
Beanspr. 

hohe 

Beanspr. 

sehr hohe 
Beanspr. 

sehr geringe 
Beanspr, 

geringe 

Beanspr. 

eher geringe 
Beanspr. 

mittlere 

Beanspr. 

eher hohe 
Beanspr. 

hohe 

Beanspr, 

sehr hohe 
Beanspr. 

sehr geringe 
Beanspr. 

geringe 

Becnspr. 

eher geringe 
Beanspr, 

mittlere 

Beanspr, 

eher hohe 
Beanspr 

hohe 

Beanspr. 

sehr hohe 
Beanspr. 

sehr geringe 
Beanspr. 

geringe 

Beanspr, 

eher geringe 
Beanspr. 

mittlere 

Beanspr. 

eher hohe 
Beanspr. 

hohe 

Beanspr. 

sehr hohe 
Beanspr. 
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AbschluB-Interview 


Pilot: Datum; Uhrzeit: 

1 . ptihlten Sie sich durch unsere zusatzliche Befragung bei 
Ihrer fliegerischen Aufgabe gestdrt? 

2. Gaben Sie Ihre Antworten automatisch Oder mit einigem 
Nachdenken? 

3. Gaben Sie Ihre Antworten, wie Sie sie auch im tSglichen 
Flugbetrieb geben wUrden, Oder empfanden Sie eine kiinst- 
liche Testsituation? 

4. Kennzeichnen Ihre Antworten eher 

die aktuelle 
AusfUhrung 

% 

% 

% 

5. Wurden die wesentlichen Teilaufgaben der Plugmission 
durch unsere Fragen erfaSt? 

6 . An welche Auf gaben oder Probleme dachten Sie wShrend der 
FlUge besonders intensiv, ohne daB wir danach fragten? 

7. Bei welchen FlUgen haben Sie nach Ihrer Meinung am meisten 
Planungsaufwand getrieben? Geben Sie eine Rangreihe, wobei 
1 am meisten Aufwand bedeutet. 


von Teilaufgaben 
(Handlungen) 

von Plugphasen 
(PlSnen) 


Oder gedankliche 

Vorausnahme 


normal 

Notfall 


normal 


auBergewohnlich 


Triebwerksaus'fall 

Hydraulikfehler 


automatisch 

□ 

□ 

□ 

□ 


manuell 




Notfall 
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8, Erfolgte Hire Planung eher automatisch (routinemMOig, R) 
Oder mit einigem Nachdenken (N) ? 

Tragen Sie die Buchstaben R Oder N ein; 




automatisch 

manuell 

normal 


□ 

□ 

auB ergew5hnl ich 

□ 

□ ’ 

Nptfall - 

Triebwerk 

Hydraulik 

□ 

□ 

□ - 
□. 


9. Halten Sie Routine Oder bewuBte Pianung ftir wichtiger? 

1 0 . Waren die FlUge am Anf ang Oder die am Ende der VersuchS- 
reihe anstrengender? 

11. Wie warden Sie unsere Experimente insgesamt beurteilen? 

12. Konnen Sie sich praktische AnwendungsmSglichkeiten vor- 
stellen? 

13. Was hat Sie besonders geSrgert? 

14. Wiirden Sie an weiterftihrenden Experimenten gern teilnehmen? 


A. Hat sich wShrend der Versuche Ihre Einstellung zu unserer 
Untersuchung bzw. das VerstSndnis dafiir, z.B. aufgrund 
von Erfahrung, geSndert? Haben Sie am Ende der Versuchs- 
reihe anders geantwortet als am Anfang? 

B. Haben Sie erfaBt, wie unser Befragungsschema aufgebaut ist? 

C. Bestehen nach Ihrer Meinung keine, geringe, mittlere Oder 
groBe individuelle Unterschiede zwischen Piloten bezuglich 
des Planungsverhaltens? 

Welcher Art sind sie? 


